[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8715) | 引用(0) | 阅读(840973)
Amazon.com/code Email Homepage
2021-1-25 14:15
Amazon is one of the leading eCommerce platforms used by millions of users all across the world. The major reason behind the massive success of Amazon is its passion for giving quality products at an affordable price range. Amazon provides its users with an extensive range of products under diverse categories.
Brother Printer Support Email Homepage
2021-1-25 14:16
Brother printers are known for their innovative designs and quality features. Therefore, because of their advanced printing features, people prefer using brother printers for personal and professional use. Moreover, brother printers are famous for their excellent printing speed and performance.
Paypal Login Email Homepage
2021-1-25 14:17
PayPal is a service that people use as a way of sending, receiving, and requesting money online. Moreover, we consider it an all-in-one payment solution for online sellers to access millions of shoppers worldwide.
AOL Mail Email Homepage
2021-1-25 14:17
AOL mail provides a great platform to interact with different people. It is a completely safe and secure platform for users to connect with anyone without their data being shared. It is also known as AIM mail. To send mails, the user should have an account on AOL mail. If the user does not have an account on AOL, he/she must create one.
gokaspersky Email Homepage
2021-1-25 16:14
Thanks for this valuable information!https://gokaspersky.com/<a href="https://gokaspersky.com/">gokaspersky</a>
office.com/setup Email Homepage
2021-1-25 18:32
To get started with your Office Installation you must need a valid product key code & visit office.com/setup and we can also help you with your entire process to setup office products online. The office is operated by users on Windows, laptop, smartphones, MacOS. The users can use Microsoft Office in any place they wish to. In case the users make any changes in their document online, then the changes will get synchronized. The user can buy an office.com/setup from both the online or offline mode.
office.com/setup Email Homepage
2021-1-25 18:33
office.com/setup can be more useful than just an email application if you pick the right subscription plan. For business, enhancing productivity and collaboration in the organization has become necessary to make it easy and more proficient for the employees to work. But, a number of businesses are still utilizing the basic plans of office.com/setup which limits them from utilizing the updated features. So, to ensure you get every feature and use your Office 365 subscription the most.
Office Setup With Product key Email Homepage
2021-1-25 20:26
Purchase the activation key and use the key for download, registration, and activation . Office Setup With Product key
Office Setup With Product key Email Homepage
2021-1-25 20:27
Purchase the activation key and use the key for download, registration, and activation <a href="https://officesetwithproductkey.com/">Office Setup With Product key</a>
Office Setup With Product key Email Homepage
2021-1-25 20:27
Purchase the activation key and use the key for download, registration, and activation <a href="https://officesetwithproductkey.com/">Office Setup With Product key</a>
quickbooks Email Homepage
2021-1-26 16:30
Some quickbooks error codes also give a lot of problems. Due to which many users also face lots of difficulties in using QuickBooks. In which some files of your company are also lost and you face difficulty in keeping the files of your company in it. Some of these are known as quickbooks error 3371 and 11118. for mcafee and aol errors:mcafee.com/activateaol email login
markw Email Homepage
2021-1-26 19:35
Trouble to opt for Cash App card balance due to icon error? Will convey help. If the image is coming up short and by obstruction of that you can't cash app card balance, by then you should see some Youtube keep up vids to enlighten you in getting the problem resolved. In addition to that, you can also use the troubleshooting tips of the consultancies that have a high success rate.
markw Email Homepage
2021-1-26 19:45
Similarity glitch causing sibling remote Canon MG3620 Setup disappointment? Call uphold group. On the off chance that there's a similarity glitch that is causing sibling remote Canon MG3620 Setup disappointment, at that point you should visit the help page and look at the similarity or you can go to Youtube recordings to discover the issue by observing some tech help recordings. Notwithstanding that, you can explore to the assistance place and look at their FAQs for some assistance.
mcafee Email Homepage
2021-1-27 16:59
paypal login provides online payment solutions to its users worldwide. mcafee.com/activate : We will tell you how you can download, install and activate Mcafee Antivirus in your mac or windows.
slotxo Email Homepage
2021-1-28 16:35
เกมสล็อตแตกบ่อย จ่ายจริง แจกรัวๆ เกมสล็อตออนไลน์ได้รับการการันตีแล้ว ว่านักเดิมพันสามารถเล่นเกมได้ตลอดและสามารถรวยได้เพียงชั่วข้ามคืน เท่านั้น ณ เวลานี้คงต้องยกให้เกมสล็อตออนไลน์เป็นเกมที่ทำเงินและสามารถสร้างรายได้ ได้ตลอด 24 ชั่วโมง ด้วยเหตุนี้ จึงมีหลายเว็บไซต์เริ่มที่จะทำการเปิดเว็บไซต์และเกมออนไลน์ต่างๆ เพิ่มมากขึ้น จึงทำให้เป็นที่นิยมในหมู่นักเสี่ยงโชคเลยก็ว่าได้ แต่เพราะเหตุนี้จึงทำให้เว็บไซต์ที่มีอยู่บนโลกมีจำนวนที่เยอะ ทำให้ลูกค้าหน้าใหม่ๆที่จะทำการทดลองเล่น ไม่รู้ว่าจะเข้าเล่นเว็บไซต์ไหนดี เราจึงได้หยิบเว็บไซต์มาแนะนำ เป็นเว็บไซต์ที่แอดมินยืนยันเลยว่า ดีที่สุด ณ ขณะนี้เลยก็ว่าได้ คลิกลองเล่นhttps://www.xopgth.com/https://xojoker.com/https://www.xoautobet.com/https://www.xogclubth.com/https://www.xosuperslot.c...
LocalBitcoins Clone Script Email Homepage
2021-1-28 18:14
LocalBitcoins Clone Script Email Homepage
2021-1-28 18:14
WSWS Email Homepage
2021-1-28 20:18
Garmim launch some new product and site.<a href="https://sites.google.com/view/mywifiext.net-/">mywifiext.net</a>. Is a neighbouring website page or page address <a href="https://sites.google.com/view/mywifiext-net-/">Netgear </a>. It is a sort of login page to get WI-FI extender gadget. If n’t you can physically enter mywifiext.net<a href="https://sites.google.com/view/mywifiext-net-/">netgear extender </a> . The best thing about this site is that. It’s speed and service availability. You can open mywifiext.local with no assistance.<a href=”https://sites.google.com/view/mywifiext-net-local/”>mywifiext.local</a>No limits.
分页: 200/436 第一页 上页 195 196 197 198 199 200 201 202 203 204 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]