[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8742) | 引用(0) | 阅读(862660)
installvipre Email Homepage
2019-11-8 15:44
Alenarose Email Homepage
2019-11-8 17:58
Soon windows 7 is going to end, but that hasn’t discouraged people from using it. Microsoft is all set to end Windows 7 in just a few months. But some people still wants to restore Windows 7 on their devices. There are several reasons why people are refusing to dump Windows 7. It offers familiarity and simplicity that other versions of Windows do not have. Some users may have had a bad experience with Windows 8. Windows 7 offers everything you want in an OS.
josepireh12 Email Homepage
2019-11-8 19:58
TADARISE 20 MG Want to increase romance time???? Buy Tadarise 20 MG Tablets Online at the world's most trusted pharmacy store. Check out reviews, uses & side effects
isabella0123 Email
2019-11-9 15:35
McAfee is recognized globally for providing the best antiviruses as it protects your device from every online threat. Be it a virus, malware, Trojan, or worm McAfee antivirus can handle them all. The antivirus system optimizes your system to allow smooth and safe browsing. If you are looking for antivirus software, then McAfee is your choice.mcafee.com/activate | mcafee.com/activate
isabella0123 Email
2019-11-9 15:36
Antivirus locates and terminates threats to your system. It also provides protection when you are browsing through the internet. The market is filled with numerous antivirus software that claims to offer total protection to your PC. There are over thousands of antivirus available on the market. Significant companies provide antivirus for you to install, but the best among the group is MacAfee antivirus.mcafee.com/activate | mcafee.com/activate
isabella0123 Email
2019-11-9 15:37
McAfee provides real-time security against all new and old threats that lurk in the digital world. Sometimes, users see that whenever they open a browser, they get McAfee subscription has expired error. If you are getting this error, then here is what you need to do.mcafee.com/activate | mcafee.com/activate
www.avg.com/retail Email Homepage
2019-11-11 14:21
AVG is has taken place in each system within several years by providing the best antivirus services. AVG is an antivirus program supplied by AVG Technologies with 100% guaranteed security features. Users can download and activate this antivirus from www.avg.com/retail
ava
2019-11-11 14:45
This is QuickBooks’s best phone number, the real-time current wait on hold and tools for skipping right through those phone lines to get right to a QuickBooks agent.QuickBooks Customer Service | QuickBooks customer service number |QuickBooks customer service phone number    | QuickBooks Support Phone Number
ava
2019-11-11 14:45
This is HP’s best phone number, the real-time current wait on hold and tools for skipping right through those phone lines to get right to a HP agent. HP Printer Customer Service | HP Printer Customer Service number | HP Printer Customer Service phone number | HP Printer Support Phone Number |
Adsa Email Homepage
2019-11-11 14:59
Norton Antivirus defends your computer, Mobile, Tablet against viruses, malware, trojan, Ransomware and, other online threats. You can protect your computer through Norton Antivirus by simply download it in easy steps, Just click on the link following link.http://w-norton-norton.com/http://w-norton-norton.com/how-norton-setup-helps-in-fixing-problems/<a href="http://w-norton-norton.com/">Norton.com/setup</a><a href="http://w-norton-norton.com/how-norton-setup-helps-in-fixing-problems/">Norton.com/setup</a>
Finn Email Homepage
2019-11-11 18:00
Webroot Secureanywhere is the antivirus offers by Webroot through webroot secure . It clears all the junk, Virus, Malware, Spyware, Trojans, Worms, ransomware, phishing attacks, adware, and other threats from multiple devices. www.webroot.com/secure |  webroot.com/secure
trendmicro-activate Email Homepage
2019-11-11 18:06
Trendmicro activate for your mac and pc.When you activate trendmicro antivirus, it protects your device from unwanted threats.Below mentioned are the services provided by trendmicro activation https://trendmicro-activate.com/https://trendmicro-activate.com/activate-trend-micro-internet-security/https://trendmicr... href="https://trendmicro-activate.com/">trend micro activation</a><a href="https://trendmicro-activate.com/activate-trend-micro-internet-security/">activate trend micro internet security</a><a href="https://trendmicro-activate.com/install-trend-micro-activation-code/">install trend micro activation code</a><a href="https://trendmicro-activate.com/trend-micro-internet-security-activation/">trend micro internet security activation</a><a href="https://trendmicro-activate.com/trendmicro-com-activate/">trendmicro.com/activate</a>https://trendmicro-activate.com/
fiodyjuy Email Homepage
2019-11-11 19:22
Kamagra Want to 60 Minute Erection without loss stamina??? Buy online Kamagra pills which is 100% FDA Verified to used cure ED function for men. Free shipping +Malegra 200 Mg  Boost your power of intimacy with partner buy Malegra 200 MG at 100% trusted pharmacy brand which is the latest treatment for erectile dysfunctionTadarise Pro 40 Mg Want to hardcore experience without early discharge? Buy Tadarise Pro 40 Sunrise at your 24 hours pharmacy store. Check out Reviews, price, Dosage or DealsTadasoft 20 Mg Ever wondered the new romanceEver wondered the new romance position? Buy Assurans 20 Online which is helping to cure erectile dysfunction for men. check out uses, reviews &amp; dosageTadalista Ct 20 Mg Want to change your partner voice during romance? Buy Tadalista CT 20 Pill at your 100% Trusted Generic Viagra Store. Check out Deals &amp; OFFERShttps://www.flatmeds.com/product/kamagra/
fiodyjuy Email Homepage
2019-11-11 19:28
Malegra 200 Mg Boost your power of intimacy with partner buy Malegra 200 MG at 100% trusted pharmacy brand which is the latest treatment for erectile dysfunction
genericonline Email Homepage
2019-11-12 16:43
<a href="https://www.genericday.com/cenforce-d.html">CENFORCE D</a> Reliable place to buy Cenforce D with PayPal &amp; credit card also check out uses, side effects &amp; offers. The Offer is valid till midnighthttps://www.genericday.com/cenforce-d.html
genericonline Email Homepage
2019-11-12 16:45
<a href="https://www.genericday.com/cenforce-120-mg.html">CENFORCE 120 MG</a> Buy 100% original cenforce 120 mg online at 100% trusted pharmacy brand which is the latest treatment for erectile dysfunctionhttps://www.genericday.com/cenforce-120-mg.html
Bitdefender login Email Homepage
2019-11-12 17:24
Bitdefender Login provides automatic upgradation and continuous protection to your device. It gives you all-round protection for your home, business and enterprises.
Garmin Login Email Homepage
2019-11-12 17:24
Garmin is a leading champion of consumer and professional class products that integrates the cutting edge GPS technology. It offers an enormously wide range of products for aviation, automotive, marine, outdoor, fitness and sports activities. For eg. Satellite Navigation device, GPS based Wearable Devices, Cameras, Software Applications,
BT Mail Email Homepage
2019-11-12 17:24
BT Mail integrates some of the most ingenious, resourceful and user friendly features to offer best in class, avant garde mailing service. Given below is a glimpse of some of it’s wonderful features:-
分页: 94/438 第一页 上页 89 90 91 92 93 94 95 96 97 98 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]