[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8743) | 引用(0) | 阅读(863082)
Hasibul
2020-3-29 13:59
HP Printer says offline Email Homepage
2020-3-30 21:58
We will likewise advise the peruser on how to look for the help of the specialists if someone faces his HP Printer Offline in Windows 10 or Mac.
HP Printer says offline Email Homepage
2020-3-30 21:59
We will likewise advise the peruser on how to look for the help of the specialists if someone faces his HP Printer offline in Windows 10 or Mac.
Cheapnotic Homepage
2020-3-30 23:14
Is it true that you are searching for an approach to buy modest yet interesting devices on the web? You've discovered it with Cheapnotic! Cheapnotic causes you to buy the most recent and extraordinary devices from excellent stores and brands! Peruse our contraption assortment. We are certain that you will find that contraption you can't survive without!Cheap GadgetsCheap Gadgets
kamal ji Email Homepage
2020-3-31 02:23
nice website love to visit this website love problem solution baba ji
jameswilly Email Homepage
2020-3-31 15:01
Data Analysis Assignment HelpLast day was left to submit my Data Analysis Assignment and was much tensed. While surfing internet I came to know about you. Because of you only I was able to submit my project before deadline and one thing which i liked https://www.myassignmenthelp.net/data-analytics-assignment-help文字文字
jameswilly Email Homepage
2020-3-31 15:04
I got SPSS Assignment Help and homework really used to get me worked up but now no longer. Thanks to the brilliant assignment and homework help services of assignment help things have fallen into place. With their commitment driven services everything seems to be a cakewalk.https://www.myassignmenthelp.net/spss-assignment-help
how to activate mcafee Email Homepage
2020-3-31 16:42
Thanks for sharing the information, your writing skills are really impressive.<a href="https://wwwmcafeecomactivatee.com/mcafee-activate/mcafee-activate/">how to activate mcafee </a>
Digital Ultras Email Homepage
2020-3-31 18:49
This is very informative and interesting post.
Digital Ultras Email Homepage
2020-3-31 18:50
This is very informative and interesting post.<a href="https://digitalultras.com/ ">Digital Ultras</a>
15 august status in 2020 Email Homepage
2020-3-31 18:51
Great post Thanks for sharing a very powerful post.https://digitalultras.com/happy-independence-day-wishes-quotes/
happy independence day images Email Homepage
2020-3-31 18:52
https://digitalultras.com/happy-independence-day-wishes-quotes/The article is very useful for me
15 august day wishes in Hindi Email Homepage
2020-3-31 18:52
https://digitalultras.com/happy-independence-day-wishes-quotes/That is what, I am looking for. Thank you for posting such articles.
happy independence day wishes Email Homepage
2020-3-31 18:53
https://digitalultras.com/happy-independence-day-wishes-quotes/Nice Article.Learn to more information,thanks for sharing in this post,Its Wonderful job.
happy independence day wishes quotes Email Homepage
2020-3-31 18:53
https://digitalultras.com/happy-independence-day-wishes-quotes/This is very nice thanks for update it's very informative
jameswilly Email Homepage
2020-3-31 19:32
R Studio Assignment HelpExcellent assignment help website. Got very good R Programming Assignment help from expert tutors. Gained deeper understanding of tough topics: R Studio Assignment Very helpful and supportive team. I would recommend this website if someone wants to gain in depth understanding on tough subjects like I did. Thank you, thank you so muchR Studio Assignment Helphttps://www.myassignmenthelp.net/r-language-assignment-help
jameswilly Email Homepage
2020-3-31 19:34
Tableau Project HelpTableau Project HelpPHD in Tableau Assignment Help has always been a tiresome experience. With so many assignments and thesis to write but no longer with myassignmenthelp.net. With the exceptional guidance and online tutoring sessions about the tutors things have become so simple such that it is unimaginable.
todoo Email Homepage
2020-3-31 20:48
Since Nicolás Maduro declared in July that Banco de Venezuela , the biggest open bank inside the South American country, would work with Petro , the financial foundation has become the fundamental player in the division in supporting the state digital money. When the Venezuelan president provided the banco de venezuela Banco de Venezuela with the Petro, the formation of "exceptional ticket workplaces" was told so individuals could complete tasks with the cash, just as to teach the individuals who were ignorant of the undertaking subtleties. With the dissemination of the Christmas reward of half Petro taught by the legislature for this December, the Bank of Venezuela started to tell the chance of making Petro wallets inside its framework. The essential target of this mix was to introduce a less complex arrangement for PetroApp's own enrollment and confirmation process, Petro's local wallet, since the framework was introducing confusions and grievances from clients who alarmed that they had just been going after for a few days to be checked on the stage and had no outcomes. What are Venezuelans doing with the Petro medium gotten in the Patria handbag? Comprehensively, Nicolás Maduro himself openly referenced that he didn't see plainly what the whole procedure of client enrollment and ensuing wallet creation resembled inside PetroApp. En cualquier caso, ocho toneladas de oro fueron expulsadas de las bóvedas del banco Focal de Venezuela hace una semana, una persona designada por restricción y tres fuentes gubernamentales mal concebidas dijeron a Reuters, en la indicación más reciente de la nerviosidad de Nicolás Maduro por dinero en efectivo. dinero entre la fijación de sanciones. banco caroni El oro fue sacado en vehículos legítimos entre el miércoles y el viernes de una semana atrás, cuando no había relojes de seguridad presentes en el banco bicentenario dijeron el diputado Ángel Alvarado y las tres fuentes del gobierno mal concebido. "Tienen la intención de venderlo ilegalmente en el extranjero", dijo Alvarado en una reunión. El banco nacional de Venezuela no reaccionó an una solicitud de aportes. Alvarado y las fuentes mencionadas anteriormente, que hablaron sobre el estado de anonimato, no indicaron a dónde se enviaba el oro. Se dieron cuenta de que la actividad ocurrió mientras el líder del Banco Central, Calixto Ortega, viajaba al extranjero.En 2018, informa Reuters, 23 toneladas de oro extraído se trasladaron de Venezuela an Estambul en avión, según fuentes e información del gobierno turco. El banco de venezuela Central compró una parte de este oro en campamentos mineros en el sur de Venezuela y fue enviado a Turquía y a diferentes naciones para respaldar el stock esencial de alimento, dada la deficiencia general, según más de 30 personas familiarizadas con esta actividad.Alrededor de 20 toneladas de oro fueron expulsadas de las cargas del Banco Central en 2018, como lo indica la información del banco, dejando 140 toneladas, el nivel más bajo en 75 años. La organización de especulación Noor Capital, de Abu Dhabi, demostró el 1 de febrero que compró tres toneladas de oro el 21 de enero al banco del tesoro  Focal de Venezuela y que no obtendría más hasta que las circunstancias en la nación caribeña se equilibraran. Noor Capital dijo que su compra mantuvo "las leyes y estrategias mundiales actuales" en ese momento. banco de venezuela
oliverjohn Email Homepage
2020-4-1 00:18
For kids roblox is the best online gaming patform for which they will get free robux codes for a level up. Get free Robux codes for Roblox the best online gaming platform for all gamers, it provides a wide variety of games for which you can generate free Roblox Robux codes through our code generator tool.
govt jobs Email Homepage
2020-4-1 14:26
govt jobsLivegovjob is a leading Job site for Freshers who seek employment opportunities in both Private and Government sectors in India. Livegovjob - We provides you all the latest official Sarkari Result, सरकारी रिजल्ट्स, Online Forms, Sarkari Naukri Jobs in various sectors such as Railway, SSC, Arm..y, Navy, Police, UPPSC, UPSSSC & other sarkari job alerts at one place.  <a href=”www.livegovjob.com”>govt jobs</a>
分页: 140/438 第一页 上页 135 136 137 138 139 140 141 142 143 144 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]