[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8738) | 引用(0) | 阅读(861436)
Carlotta Homepage
2022-9-7 14:12
Informative blog post. Thanks for sharing great content with us. I bookmark your blog and will visit again to know more information. Actually I am working with focus hr company whose main aim is to protect people with principles. They offers  hr outsourcing service providers such as human resources, payroll services, time and attendance solutions, retirement planning, and so on. Protect your company with our recommendations HR Outsoucing Service Providers
dzfgvxdfb Email
2022-9-7 19:09
Your Uphold login accounts are considered the safest online location to hold Bitcoin, trade among the crypto variants, several precious metals and tons of different local currencies so, users can use the online platform without being worried at all.https://upholdlgini.mobirisesite.com/https://geminisign-in.mobirisesite.com/https://krkenlgin9u.mobirisesite.com/https:/...
maria
2022-9-7 20:02
Thank you for this wonderful post! It has long been extremely helpful. I wish that you will carry onposting your knowledge with ushttps://metamaskklogi.mobirisesite.com/https://metamaskkl0ginn.mobirisesite.com/https://robinhood-wallet.mobirisesite.com/https://robinhoodwallet.mobirisesite.com/https://uppholdl0gin.mobirisesite.com/https://upholddl0gin.mobirisesite.com/https://kucoinnl0gin.mobirisesite.com/https://kucoinloggin.mobirisesite.com/https://metsmaskllog.mobirisesite.com/https://upiholdlogi.mobirisesite.com/https://upiholdlogi-01.mobirisesite.com/https://kuconllogiin-01.mobirisesite.com/https://kuconl-logiin-01.mobirisesite.com/https://rubihood-llogiin.mobirisesite.com/https://rubihood-llogiins.mobirisesite.com/
gzfhd Email Homepage
2022-9-7 20:19
https://sites.google.com/xn--cryptwallt-76a9i.com/opensea-marketplace/home
hdkawlkdo Email Homepage
2022-9-8 14:23
https://sites.google.com/xn--cryptwallt-76a9i.com/opensea-marketplace/home
micheal roy Email
2022-9-8 17:13
we can say that the metamask sign in app is diverse in nature and can be used for accomplishing different tasks on the go.metamask sign inAs the Metamask sign in platform adds functionality to the browser, Metamask needs permission to read and write to any of the web pages.metamask sign in
Jack Email
2022-9-8 20:05
Since Coinbase Wallet is a digital wallet, it uses hot storage. This refers to crypto storage that is connected to the internet. The most secure type of storage is cold crypto storage, which is when you store it offline, normally in a hardware wallet.https://coinbaswallet.siterubix.com/https://mitamaskextension.siterubix.com/https://metamaskwallet-us.siterubix.com/http...
majorsite Homepage
2022-9-9 09:54
It's really great. Thank you for providing a quality article. There is something you might be interested in. Do you know majorsite ? If you have more questions, please come to my site and check it out!http://images.google.com/url?sa=t&url=https%3A%2F%2Foncainven.com
elux Email Homepage
2022-9-9 19:01
eluxe ;eluxe ;eluxe ;eluxe ;eluxe ;eluxe ;eluxe ;
kaladhara Email Homepage
2022-9-10 19:31
Trust WalletMetaMask Sign InMetaMask Log InMetaMask WalletMetaMask Sign InMetaMask ExtensionCoinbase Wallet Log InCoinbase Pro Log InCoinbase ExchangePro.coinbase.com Log inTrezor.io/startTrezor.io/startTrezor WalletLedger.com/startLedger WalletBlockfi Log inSushiswap ExchangeUniswap Exchange
janne Homepage
2022-9-11 16:48
If you think you are not able to sign in to your account due to one of these reasons, then you should find a relevant solution to fix the PayPal login issues. Read this article to get more details.ij.start.cannonPayPal Sign inPayPal Sign inPayPal Sign inquickbooks online loginxfinity logincash app loginWhatsapp Webshowtime anytime activate | spectrum login | hulu login | 123.hp.com/setup | PayPal Sign inPayPal Sign in
Phantom Wallet Email Homepage
2022-9-11 18:38
You can deposit and save Solana crypto assets including SOL, Solana Nut, Fabric, and Dexlab using Phantom Wallet , a web-based and mobile digital wallet. You may also access several decentralized web platforms with this cryptocurrency wallet. Your Solana coins are kept in a phantom crypto wallet on the blockchain. With the use of a 12-word secret recovery phrase, you can control your wallet. Devices running Android, iOS, Mac, and Windows can access this wallet.https://phntomwallet.com/
janne Homepage
2022-9-11 18:48
https://sites.google.com/view/amazonprimevideologin-ushttps://sites.google.com/view/quickbooksqb/https://sites.google.com/view/xfinityloginusa/https://sites.google.com/view/cashapploginiusa/https://sites.google.com/view/whatsappwebhind/https://sites.google.com/view/paypalemailloginus/https://sites.google.com/view/spectrum-mail/https://sites.google.com/view/hululoginusa/https://sites.google.com/view/123hpcomus/https://ijprosmart.us/https://mykashipur.com/
fgdfgdf Email
2022-9-11 21:28
Shibaswap SHIB, LEASH, and BONE, come together to create ShibaSwap, the next evolution in DeFi platforms. ShibaSwap gives users the ability to DIG (provide liquidity), BURY (stake), and SWAP tokens to gain WOOF Returns through our sophisticated and innovative passive income reward system.https://exoduswallezt.mypixieset.com/ | https://exoduswalletz.mypixieset.com/ | https://binancewalleet.mypixieset.com/ | https://roninwalletzs.mypixieset.com/ | https://coinbassewallet.mypixieset.com/ | https://coinbasewalletz.mypixieset.com/ | https://phantomwalletz.mypixieset.com/ | https://phantomwalllet.mypixieset.com/ | https://axieinfinity.mypixieset.com/ | https://shibaswaps.mypixieset.com/ |
Paypal Login Email
2022-9-12 04:22
PayPal works as an intermediary between you and a bank. A user adds a bank account or credit/debit card to the PayPal system and whenever they're making an online payment, they can select which account to debit Paypal Login All transactions are processed through PayPal, instead of your bank.When someone sends you money, you'll receive a notification via email and/or the PayPal app. The money is deposited into your PayPal account. In Paypal Login You can keep the money in your PayPal account to apply it toward future transactions or transfer it to your bank account.You don't need a bank account to sign up for Paypal Login or to receive payments. You can, however, connect your PayPal account to a bank account, a debit card or a credit card account for sending and receiving payments and transferring funds.PayPal is a highly secure financial service, backed with some of the best end-to-end encryption available. You should also make Paypal Login sure to enable two-factor authentication, and delete any unused bank accounts or email addresses. Even with all this security, remember that no online service is immune to hacking or theft.
PayPal log in Email Homepage
2022-9-12 12:42
PayPal log in is an online service that provides a convenient way to transfer money. You can send and receive money online for products and services.https://sites.google.com/walletlogs.com/paypallogin/home
jasonwilson Email Homepage
2022-9-12 17:58
Cenforce 100 known as a Blue pill, Sildenafil Citrate will treat s*xual impotence in males. This tablet helps raise blood circulation from the penile to help a man get harder and maintain a very long erection. This medication is generally generally used for Treating Minor heart ailments and impotence problems. It is widely considered a Wonderful alternative to viagra by most and Can be readily utilized to fight your issues of ED. The medication's 100 mg dose gives consumers to get and maintain an Erection by themselves upon s*xual stimulation. This property of medication makes it widely acceptable by individuals of all generations. It contains Sildenafil Citrate which has been used to heal the condition of erectile dysfunction. The drug is a PDE5 inhibitor that works by inhibiting the motion of the PDE5 enzyme.
aaa Email Homepage
2022-9-12 18:14
Binance Wallet: Most trading platforms also serve as crypto wallet, which makes allot of sense. Its much more easier to trade when you can actually store your crypto in same platform. And Binance is no exception and you can access the Binance crypto wallet feature from its Mobile App.https://exoduswalleta.mypixieset.com/https://exodoswallet.mypixieset.com/https://binancewollet.mypixieset.com/https://ro...
分页: 331/437 第一页 上页 326 327 328 329 330 331 332 333 334 335 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]