[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8716) | 引用(0) | 阅读(842743)
Norton setup Email Homepage
2019-10-30 13:47
Norton.com/setup - Now Install Norton Setup by just entering the 25-Digits Norton Setup Product Key in order to Get Norton Installed at www.norton.com/setup. For more information call our norton support number.
asni Email Homepage
2019-10-30 14:00
McAfee activate - Simple Steps to Activate McAfee using McAfee Activate Product Key mentioned at the back of McAfee Retail card. McAfee Activate Now.
asni Email Homepage
2019-10-30 14:01
kaspersky login  hold no association or affiliation with any of these brands or third-party companies and solely provide support service for the product issues faced by users If your product is covered by warranty, then the support services we are providing may also be available for free from manufacturer official website support kaspersky.
asni Email Homepage
2019-10-30 14:01
kaspersky login is an independent support provider on On-Demand Remote Technical Services For Kaspersky  products, kaspersky login is an independent service provider for software related issues in desktops, laptops, devices, and peripherals.
asni Email Homepage
2019-10-30 14:01
Microsoft Office is a full-fledged suite of different subscription-based services and applications. It is a combination of best-in-class apps that are designed to meet the various demands and needs of the users. In order to access these services to improve your work productivity both at the office or at home, you have to download and install the Office application. For this, visit office.com/setup and activate, download and install the software. You can follow the given procedures for experiencing error-free processes.
asni Email Homepage
2019-10-30 14:02
Rand McNally GPS updates are installed automatically on connecting to the WiFi. However, some of the devices require a straightforward manual process. The manual process can be easily completed with the help of an interactive, fun interface called Dock.
asni Email Homepage
2019-10-30 14:02
Webroot has advanced security that helps to protect your private and financial information when you go online. This antivirus software is updated regularly and automatically so that your computer remains safe. It has a large malware database.
asni Email Homepage
2019-10-30 14:03
Trend Micro is cloud-based antivirus software that defends your system against viruses and other malware. Also, this antivirus software safeguards against email scams. It has advanced security technology that keeps you secure when shopping or banking online. Trend Micro safeguards documents from unauthorized encryption. Hence, just after completing the Trend Micro login, you can access the various Trend Micro products and services.
asni Email Homepage
2019-10-30 14:03
AVG is a well-recognized name in the domain of cybersecurity solutions. It offers sophisticated and user-friendly products that are undoubtedly the best of the breed. However, such innovative products require a user-friendly management platform to allow users to experience their full potential. As such, users are provided with the AVG login account to simplify the use of a technical genius.
Jannifer Email
2019-10-30 15:01
Language doesn't generally need to wear a tie and trim up shoes. The object of fiction isn't linguistic accuracy yet to make the peruser welcome and afterward recount to a story… to make him/her write my essays/ overlook, at whatever point conceivable, that he/she is perusing a story by any means. "
Office.com/setup Email Homepage
2019-10-30 17:50
I am extremely intrigued with your article. I adore the manner in which you compose this article. Much obliged to you for imparting this awesome post to us.norton.com/setup | office.com/setup
garmin.com/express Email Homepage
2019-10-30 20:47
garmin.com/express /Garmin express   Garmin.com/express - Garmin express is a software application designed by the company to update, install and manage all the garmin devices from your desktop only.http://www.mygarminexpress.com/
rick and morty Homepage
2019-10-30 21:30
Rick And Morty follows the animated, interdimensional adventures of alcoholic scientist Rick Sanchez and his grandson Morty. Due to Rick’s selfish, nihilistic behavior, these adventures often spiral out of control in horrifying ways, leaving Morty and his family with severe mental scars. Rick And Morty’s mix of sharp comic writing and fascinating sci-fi premises quickly saw it become a huge cult favorite.Fans had a long wait between Rick And Morty season 2 and 3, with the final scene of the second season finding recurring character Mr. Poopybutthole breaking the fourth wall to tease the show might not be back for “a year and a half.” Season 2’s finale “The Wedding Squanchers” ended on a major cliffhanger, with Rick turning himself into the Galactic Federation to save his family. Adult Swim would later shock fans by suddenly airing Rick And Morty season 3 episode 1 on April 1, 2017, on a loop with no promotion. In a meta twist, this also matched the “year and a half” Mr. Poopybutthole had previously warned fans would have to wait.SET 1 Here’s how to watch rick and morty season 3 episode 1 “The Rickshank Rickdemption” changed the <a href="https://rickandmortytv.online/">rick and morty</a><a href="https://rickandmortytv.online/rick-and-morty-season-3-episode-7/">Rick and Morty Season 3 Episode 7</a><a href="https://rickandmortytv.online/rick-and-morty-season-3-episode-8/"> Rick and Morty Season 3 Episode 8</a><a href="https://rickandmortytv.online/rick-and-morty-season-3-episode-9/">Rick and Morty Season 3 Episode 9</a><a href="https://rickandmortytv.online/rick-and-morty-season-3-episode-10/">Rick and Morty Season 3 Episode 10</a><a href="https://rickandmortytv.online/rick-and-morty-season-4/">rick and morty season 4</a>SET 2<a href="https://rickandmortytv.online/">rick and morty</a><a href="https://rickandmortytv.online/rick-and-morty-season-4/">rick and morty season 4</a><a href="https://rickandmortytv.online/rick-and-morty-season-4-episode-1/"> Rick and Morty Season 3 Episode 1</a><a href="https://rickandmortytv.online/rick-and-morty-season-4-episode-2/"> Rick and Morty Season 3 Episode 2</a><a href="https://rickandmortytv.online/rick-and-morty-season-4-episode-3/">Rick and Morty Season 3 Episode 3</a><a href="https://rickandmortytv.online/rick-and-morty-season-4-episode-4/"> Rick and Morty Season 3 Episode 4</a><a href="https://rickandmortytv.online/rick-and-morty-season-4-episode-5/"> Rick and Morty Season 3 Episode 5</a>
Webroot.com/safe Email Homepage
2019-10-31 17:41
Webroot.com/safe really is a condition of the art cyber-security applications which expands smart safety alternatives to the associated universe. This is really a complex multi-device cyber-security approach built to forecast and defend from cyberattacks in actual moment.http://www.webrootsafee.us/ /
dorothyavam Email Homepage
2019-10-31 17:47
Want to learn the best singing classes in Noida then come to us at musicologypro.
jiyakhan Email Homepage
2019-11-1 14:33
If you are looking hot and experienced independent newly top sexy high profile Escorts in Chandigarh than make a simple call 9888014299 and hire me.
Office.com/Setup Email Homepage
2019-11-1 14:40
This new office.com/setup will simply help its users to find the list of apps as well as services available to them. It also helps to install office locally. This new version is fast and easy to use. Here we are listing a few reasons to use this app.
Office.com/Setup Email Homepage
2019-11-1 14:41
Download and install and office setup from office.com/setup . log in and enter office 25 digit product key to activate your office product.
Alenarose Email Homepage
2019-11-1 14:58
Windows includes different troubleshooters designed to quickly diagnose and automatically solve computer problems. Troubleshooter windows 10 can’t fix everything, but they’re a great place to start if you encounter a problem with your computer. In many cases, Windows 10 configuration problems are minor annoyances that can be fixed simply if you know where to look for the right setting. However, for many users, not knowing where to find a configuration setting is really the primary problem. By using the built-in Windows 10 Troubleshooter, users aren't required to know where a configuration setting is they can just let the computer fix itself.
分页: 91/436 第一页 上页 86 87 88 89 90 91 92 93 94 95 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]