[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8742) | 引用(0) | 阅读(862691)
ariasmith751 Email Homepage
2020-1-31 20:00
Your Comcast Xfinity device may be activated online. Simply see xfinity.com/authorize and follow this manual to get your device up and running right away.
Jones Wilson Email Homepage
2020-1-31 23:55
The article has truly beat my slant. I am going to bookmark your site and keep up checking for flashing new information.Regards,www.office.com/setupoffice.com/setupwww.office.com/setup
Jones Wilson Email Homepage
2020-1-31 23:55
I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work…Regards,www.norton.com/setupwww.office.com/setupwww.office.com/setup
Enter Kaspersky activation code Email Homepage
2020-2-1 10:29
Enter Kaspersky with activation code states to the name found to the online security established by activation Lab for giving broad protection to the user's system having against malware attacks. Aside from malware safeguard, the item has an extraordinary cluster of highlights like parental control for watching their children’s action, secret key lapse, reinforcement and reestablish information, against phishing and, firewalls to obstruct all the malignant websites.
download kaspersky using activation code Email Homepage
2020-2-1 10:38
Download Kaspersky Already Have Keycode is a nice choice to have for your own or business needs. This is a standout amongst the most prominent security arrangements available worldwide and you can find it here at Antivirus complete security. In addition to the fact that we assist you to get the antivirus application introduced. Antivirus protection is essential for your PC and dependably its most recent form must be offered and promising refreshed.
my kaspersky login Email Homepage
2020-2-1 10:42
Activate the Kaspersky security program on your device with URL my kaspersky login. Kaspersky gives its users an assurance against different types of threats, arranges and phishing assaults, and spam. Using Kaspersky makes you feel secure and gives you the safety shields to stop malicious files from entering the laptop, smartphones, Desktop, via Trojan horses,  spyware,  root-kit, and malware. Kaspersky is a multipurpose usable security program that is a powerful scanner, parental controls, webcam and sound assurance, online exchange insurance. Kaspersky can be Download, Install and Activate using Kaspersky Activation code.
Kaspersky download already purchased Email Homepage
2020-2-1 10:44
Kaspersky download already purchased, it has become crucial to protect your data from bugs, viruses and online theft. It is extremely important to protect your PC, Mac, mobile phones and tablets which you can achieve throughout-virus. Kaspersky Total Security is an Anti-virus that protects the sensitive data stored on your device. Kaspersky installation and activation is a simple procedure. Kaspersky security is simple to install and easy to setup. It has an activation code on the backside of its retail card. All you need to do is locate this 20 character alpha-numeric code.
www.avg.com/retail Email Homepage
2020-2-1 10:47
www.avg.com/retail is the official website where you can insert the AVG activation code and activate your AVG antivirus setup. AVG is an antivirus that grants users to safeguard their data, files, computer, mobile phone, and online work from threats. Download AVG and activating it through www avg com activation is an excellent option to secure your device from Malware, Ransomware, Phishing attacks, Adware and other threats. AVG antivirus is compatible with Windows, Mac, iOS, and android, with 100% network and data protection. After purchasing AVG Internet Security,  you require to activate the product using either an activation code or via your AVG Account that is registered with the same email address you used to create the purchase.https://my-avg.com/retail/
www.trendmicro.com/downloadme Email Homepage
2020-2-1 10:51
Trendmicro is an antivirus platform that offers you the easiest way to download Trend Micro antivirus. Trend Micro antivirus provides security for various devices, including Windows, Laptops, Mobile phones, PCs, Macs,  and smartphones. For Trend Micro Download, you must create a Trend Micro account that can help you in smooth Trend Micro installation. Once you visit www trendmicro com/downloadme, you can download and activate the trend micro exe file on your system. The Trend Micro has advanced antivirus features to provide your system multi-device and robust protection with complete solutions everywhere.
www.avg.com/activation Email Homepage
2020-2-1 10:53
AVG retail is the official website where you can insert the AVG activation code and activate your AVG antivirus setup. AVG is an antivirus that gives users to safeguard their data, files, computer, mobile phone, and online work from threats. Download AVG and activating it through www avg com activation is an excellent option to secure your device from Malware, Ransomware, Phishing attacks, Adware and other threats. AVG antivirus is compatible with Windows, Mac, iOS, and android, with 100% network and data protection. Here you required to enter the unique AVG activation code so that you can successfully secure your data from multiple viruses and threats in a single scan. AVG user needs to ensure the software updates before installing it in the device. Use an updated version of AVG antivirus from www avg com retail for better results and secure systems with advanced AVG technologies.
www.trendmicro.com/getmax Email Homepage
2020-2-1 10:56
www trendmicro com getmax is the antivirus and cybersecurity products from this brand are easy to use and install. You can easily download it on your device and upgrade any of the Trendmicro Antivirus products that will help you to handle this cybersecurity.  Computer security is the way toward counteracting and distinguishing unapproved utilization of your computer. Anticipation estimates help you prevent unapproved clients from getting to any piece of your computer framework. Recognition encourages you to decide if somebody endeavored to break into your framework, on the off chance that they were fruitful, and what they may have done.
www.webroot.com/safe Email Homepage
2020-2-1 14:21
webroot com safe is the right page to download your webroot product. A user may directly download webroot program from this page without creating a webroot account.  Details for creating an account in given above just after the top section.www.webroot.com/safe |webroot.com/safeInstall Webroot With Key Code
www.webroot.com/safe Email Homepage
2020-2-1 14:21
webroot com safe is the right page to download your webroot product. A user may directly download webroot program from this page without creating a webroot account.  Details for creating an account in given above just after the top section.www.webroot.com/safe |webroot.com/safeInstall Webroot With Key Code
www.webroot.com/safe Email Homepage
2020-2-1 14:22
webroot com safe is the right page to download your webroot product. A user may directly download webroot program from this page without creating a webroot account.  Details for creating an account in given above just after the top section.www.webroot.com/safe |webroot.com/safeInstall Webroot With Key Code
www.webroot.com/safe Email Homepage
2020-2-1 14:22
webroot com safe is the right page to download your webroot product. A user may directly download webroot program from this page without creating a webroot account.  Details for creating an account in given above just after the top section.www.webroot.com/safe |webroot.com/safeInstall Webroot With Key Code
Cannabis Guest Post Email Homepage
2020-2-2 16:16
This is actually the kind of information I have been trying to find. Thank you for writing this information.
Cannabis Guest Post Email Homepage
2020-2-2 16:17
This is actually the kind of information I have been trying to find. Thank you for writing this information.
Camps Intuit Email Homepage
2020-2-3 12:42
Camps Intuit is a client management portal for Quickbooks desktop. Therefore, with the guidance of this portal, you can handle your QuickBooks Desktop account in one place. This platform enables you to manage your purchases, subscriptions, personal information, billing and payment details, and other information in an easier manner.Camps Intuithttp://campsintuitt.com/
123.hp.com/setup. Email Homepage
2020-2-3 12:43
We are providing you Best Technical Support for your HP Printer. Also, Our Experts are just a call away For any kind of assistance related to your HP Printer, you just need to make a call. And we offer the support during the download of HP Printer software from 123.hp.com/setup.123.hp.com/setup.https://hp123hp.com/
分页: 117/438 第一页 上页 112 113 114 115 116 117 118 119 120 121 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]