[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8403) | 引用(0) | 阅读(715170)
Office.com/setup Email Homepage
2019-10-24 16:34
office.com/setup - Here you can download the latest version of Office the link says 2016 but the version is most updated just visit www.office.com/setup. If you are facing issues then you can contact us at our office support number. we will instantly help you and solve issues.office.com/setup
malwarebytespremium Email Homepage
2019-10-24 16:50
install malwarebytes with activation code | How to install and activate malwarebytes on multiple computers•  Each copy of a multiple-device license for malwarebytes (for example, a 3 PCs license) is installed and activated in the same way on all computers you want to protect.•  In conclusion to activate malwarebytes on all computers, use one and the same activation code you purchased.<a href="https://malwarebytespremium.org">malwarebytes.com/install</a><a href="https://malwarebytespremium.org/www-malwarebytes-com-download">malwarebytes.com/download</a><a href="https://malwarebytespremium.org/malwarebytes-download-reinstall/">install malwarebytes with activation code</a><a href="https://malwarebytespremium.org">malwarebytes download already purchased</a>
mcafee Email Homepage
2019-10-25 15:09
The McAfee activation key will be present at the rear side of the Mcafee.com/activate. when you buy McAfee products, you get its setup. In case you have made an online purchase, then check your email to find the code.McAfee.com/activate
asni Email Homepage
2019-10-25 16:15
McAfee activate - Simple Steps to Activate McAfee using McAfee Activate Product Key mentioned at the back of McAfee Retail card. McAfee Activate Now.
asni Email Homepage
2019-10-25 16:16
kaspersky login  hold no association or affiliation with any of these brands or third-party companies and solely provide support service for the product issues faced by users If your product is covered by warranty, then the support services we are providing may also be available for free from manufacturer official website support kaspersky.
asni Email Homepage
2019-10-25 16:17
kaspersky login is an independent support provider on On-Demand Remote Technical Services For Kaspersky  products, kaspersky login is an independent service provider for software related issues in desktops, laptops, devices, and peripherals.
asni Email Homepage
2019-10-25 16:17
Microsoft Office is a full-fledged suite of different subscription-based services and applications. It is a combination of best-in-class apps that are designed to meet the various demands and needs of the users. In order to access these services to improve your work productivity both at the office or at home, you have to download and install the Office application. For this, visit office.com/setup and activate, download and install the software. You can follow the given procedures for experiencing error-free processes.
asni Email Homepage
2019-10-25 16:17
Rand McNally GPS updates are installed automatically on connecting to the WiFi. However, some of the devices require a straightforward manual process. The manual process can be easily completed with the help of an interactive, fun interface called Dock.
asni Email Homepage
2019-10-25 16:18
Webroot has advanced security that helps to protect your private and financial information when you go online. This antivirus software is updated regularly and automatically so that your computer remains safe. It has a large malware database. This is a user-friendly interface that can manage multiple devices. Therefore, you can use this software with all the operating systems like Windows, Mac, Android, and iOS. You can use the backup and sync settings to make a backup of files instead of synchronizing files with multiple devices. This software also blocks dangerous websites that can steal your data.
asni Email Homepage
2019-10-25 16:18
Trend Micro is cloud-based antivirus software that defends your system against viruses and other malware. Also, this antivirus software safeguards against email scams. It has advanced security technology that keeps you secure when shopping or banking online. Trend Micro safeguards documents from unauthorized encryption. Hence, just after completing the Trend Micro login, you can access the various Trend Micro products and services.
asni Email Homepage
2019-10-25 16:18
McAfee.com/activate - Simple Steps to Activate McAfee utilizing McAfee Activate Product Key referenced at the back of McAfee Retail card. McAfee Activate Now.
webroot.com/safe Email Homepage
2019-10-26 15:36
Webroot.com/safe is a state of the art cyber security software that extends smart security solutions for the connected world. It’s a sophisticated multi-device cyber security solution designed to predict and protect against cyber attacks in real time.http://www.webrootsafee.us
jordan
2019-10-26 15:36
Garmin Express is a software designed by the company to manage and update your Garmin devices from a single place. You can download and install the Garmin Express on your desktop from the link garmin.com/express online. The software also allows you to transfer your daily activity and other data to the Garmin Connect account without any trouble.  garmin express
neha Email Homepage
2019-10-29 14:19
I must admit that your post is really awesome. I had spent a spare time of reading this content. and after reading I get pieces of knowledge thankyou for this submission.
jacob Email Homepage
2019-10-29 14:33
Aol Dektop Gold is Download most popular for its features and functions now available with all new users interface and advance security features .AOL Desktop Gold can help you accessing your emails and for searching the content and even for browsing purpose.
roku.com/link Email Homepage
2019-10-30 10:38
Roku is a streaming device, which provides the simplest way to stream entertainment channels to your TV. On your terms. You can access more than 500000+ movies and TV episodes across free and pay on Roku. Also, you will get the best quality video streaming with it. You can watch shows, movies, an entertainment channel, web series, etc.For the activation of the Roku device. roku.com/linkhttps://urlrokucomlink.com/
hulu.com/activate Email Homepage
2019-10-30 10:39
Hulu provides the simplest way to stream entertainment to your TV. On your terms. With thousands of available channels. We provide information regarding Hulu Activation Code. To activate a new Hulu account using an existing email account and you can stream television shows and movies from the Hulu site using the Hulu activation link.hulu.com/activatehttps://hulucomactivate.com
webroot.com/safe Email Homepage
2019-10-30 10:41
Webroot.com/safe is the only security solution which can protect your system from viruses, worms, malware threats. Get Webroot safe today & install on your system and say goodbye to viruses.webroot.com/safehttps://download-webroot.com/
roku.com/link Email Homepage
2019-10-30 10:42
Roku is a package of entertainment. The Roku channel is the Expansion of programming for new generation children. Roku Roku declares plans to Combined kids and family movies and TV together with the channel's other content, including subscriptions, its free, television, ad-supported movies, and live TV. roku.com/linkhttps://2019roku.com
office.com/setup Email Homepage
2019-10-30 10:42
Microsoft Office, or simply Office, is a family of client software, server software, and services developed by Microsoft. Office is produced in several versions targeted towards different end-users and computing environments. The original, and most widely used version, is the desktop version, available for PCs running the Windows and macOS operating systems. office.com/setuphttps://setup-office-com.me/
分页: 90/421 第一页 上页 85 86 87 88 89 90 91 92 93 94 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]