[文章作者:张宴 本文版本:v1.2 最后修改:2008.01.02 转载请注明出处:http://blog.zyan.cc]

  我曾经写过一篇文章──《初步试用Squid的替代产品──Varnish Cache网站加速器》,但当时仅仅是用着玩,没做深入研究。

  今天写的这篇关于Varnish的文章,已经是一篇可以完全替代Squid做网站缓存加速器的详细解决方案了。网上关于Varnish的资料很少,中文资料更是微乎其微,希望本文能够吸引更多的人研究、使用Varnish。

  在我看来,使用Varnish代替Squid的理由有三点:
  1、Varnish采用了“Visual Page Cache”技术,在内存的利用上,Varnish比Squid具有优势,它避免了Squid频繁在内存、磁盘中交换文件,性能要比Squid高。
  2、Varnish的稳定性还不错,我管理的一台图片服务器运行Varnish已经有一个月,没有发生过故障,而进行相同工作的Squid服务器就倒过几次。
  3、通过Varnish管理端口,可以使用正则表达式快速、批量地清除部分缓存,这一点是Squid不能具备的。

  点击在新窗口中浏览此图片


  下面来安装Varnish网站缓存加速器(Linux系统):
  1、创建www用户和组,以及Varnish缓存文件存放目录(/var/vcache):
/usr/sbin/groupadd www -g 48
/usr/sbin/useradd -u 48 -g www www
mkdir -p /var/vcache
chmod +w /var/vcache
chown -R www:www /var/vcache


  2、创建Varnish日志目录(/var/logs/):
mkdir -p /var/logs
chmod +w /var/logs
chown -R www:www /var/logs


  3、编译安装varnish:
wget http://blog.zyan.cc/soft/linux/varnish/varnish-1.1.2.tar.gz
tar zxvf varnish-1.1.2.tar.gz
cd varnish-1.1.2
./configure --prefix=/usr/local/varnish
make && make install


  4、创建Varnish配置文件:
vi /usr/local/varnish/vcl.conf

  输入以下内容:
引用
backend myblogserver {
       set backend.host = "192.168.0.5";
       set backend.port = "80";
}

acl purge {
       "localhost";
       "127.0.0.1";
       "192.168.1.0"/24;
}

sub vcl_recv {
       if (req.request == "PURGE") {
               if (!client.ip ~ purge) {
                       error 405 "Not allowed.";
               }
               lookup;
       }

       if (req.http.host ~ "^blog.zyan.cc") {
               set req.backend = myblogserver;
               if (req.request != "GET" && req.request != "HEAD") {
                       pipe;
               }
               else {
                       lookup;
               }
       }
       else {
               error 404 "Zhang Yan Cache Server";
               lookup;
       }
}

sub vcl_hit {
       if (req.request == "PURGE") {
               set obj.ttl = 0s;
               error 200 "Purged.";
       }
}

sub vcl_miss {
       if (req.request == "PURGE") {
               error 404 "Not in cache.";
       }
}

sub vcl_fetch {
       if (req.request == "GET" && req.url ~ "\.(txt|js)$") {
               set obj.ttl = 3600s;
       }
       else {
               set obj.ttl = 30d;
       }
}

  这里,我对这段配置文件解释一下:
  (1)、Varnish通过反向代理请求后端IP为192.168.0.5,端口为80的web服务器;
  (2)、Varnish允许localhost、127.0.0.1、192.168.0.***三个来源IP通过PURGE方法清除缓存;
  (3)、Varnish对域名为blog.zyan.cc的请求进行处理,非blog.zyan.cc域名的请求则返回“Zhang Yan Cache Server”;
  (4)、Varnish对HTTP协议中的GET、HEAD请求进行缓存,对POST请求透过,让其直接访问后端Web服务器。之所以这样配置,是因为POST请求一般是发送数据给服务器的,需要服务器接收、处理,所以不缓存;
  (5)、Varnish对以.txt和.js结尾的URL缓存时间设置1小时,对其他的URL缓存时间设置为30天。

  5、启动Varnish
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on


  6、启动varnishncsa用来将Varnish访问日志写入日志文件:
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/varnish.log &


  7、配置开机自动启动Varnish
vi /etc/rc.local

  在末尾增加以下内容:
引用
ulimit -SHn 51200
/usr/local/varnish/sbin/varnishd -n /var/vcache -f /usr/local/varnish/vcl.conf -a 0.0.0.0:80 -s file,/var/vcache/varnish_cache.data,1G -g www -u www -w 30000,51200,10 -T 127.0.0.1:3500 -p client_http11=on
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &


  8、优化Linux内核参数
vi /etc/sysctl.conf

  在末尾增加以下内容:
引用
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000    65000



  再看看如何管理Varnish:
  1、查看Varnish服务器连接数与命中率:
/usr/local/varnish/bin/varnishstat

  点击在新窗口中浏览此图片

  2、通过Varnish管理端口进行管理:
  用help看看可以使用哪些Varnish命令:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 help

引用
Available commands:
ping [timestamp]
status
start
stop
stats
vcl.load
vcl.inline
vcl.use
vcl.discard
vcl.list
vcl.show
param.show [-l] []
param.set
help [command]
url.purge
dump.pool


  3、通过Varnish管理端口,使用正则表达式批量清除缓存:
  (1)、例:清除类似http://blog.zyan.cc/a/zhangyan.html的URL地址):
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge /a/

  (2)、例:清除类似http://blog.zyan.cc/tech的URL地址:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge w*$

  (3)、例:清除所有缓存:
/usr/local/varnish/bin/varnishadm -T 127.0.0.1:3500 url.purge *$


  4、一个清除Squid缓存的PHP函数(清除Varnish缓存同样可以使用该函数,无需作任何修改,十分方便):


  附1:Varnish官方网站:http://www.varnish-cache.org/

  附2:2007年12月10日,我写了一个每天0点运行,按天切割Varnish日志,生成一个压缩文件,同时删除上个月旧日志的脚本(/var/logs/cutlog.sh):
  /var/logs/cutlog.sh文件内容如下:
引用
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +"%Y-%m-%d")
pkill -9 varnishncsa
mv /var/logs/youvideo.log /var/logs/${date}.log
/usr/local/varnish/bin/varnishncsa -n /var/vcache -w /var/logs/youvideo.log &
mkdir -p /var/logs/youvideo/
gzip -c /var/logs/${date}.log > /var/logs/youvideo/${date}.log.gz
rm -f /var/logs/${date}.log
rm -f /var/logs/youvideo/$(date -d "-1 month" +"%Y-%m*").log.gz

  设置在每天00:00定时执行:
  
/usr/bin/crontab -e
  或者  
vi /var/spool/cron/root
  输入以下内容:
引用
0 0 * * * /bin/sh /var/logs/cutlog.sh



Tags: , , ,



技术大类 » Cache与存储 | 评论(8653) | 引用(0) | 阅读(806722)
stevenmark Email
2024-1-5 17:56
Paypal Login money transfer fees: Type of transaction. Your method of payment and the currency you use. Which currency do you choose for the recipient to be paid? It's crucial to be aware that using a credit card to pay for your Paypal money.
JACK Email
2024-1-5 18:12
Ethpool staking offers crypto enthusiasts a lucrative opportunity to earn passive income by locking up Ethereum in support of the network.https://sites.google.com/cryptofinances.us/ethpool/homeLido Staking provides a seamless bridge for Ethereum 2.0 staking by issuing stETH, a liquid and tradable token representing staked Ethereum. https://sites.google.com/cryptofinances.us/lidostaking/home
Chris BRown Email
2024-1-8 13:12
KuCoin Login offers a variety of trading and investment options, including the ability to buy and sell crypto with as little as $1. However, some say that KuCoin's desktop and mobile platforms are not particularly user-friendly.
shira Email Homepage
2024-1-8 14:08
MetaMask is a famous program expansion for Metamask Chrome Extension The Metamask Chrome Extension web store appears two expansions, an orange one, and a yellow one.folks, I simply need to specify something I notice when I research for Metamask expansion on Google Chrome Program
bbmp khata online Email Homepage
2024-1-8 18:56
Provides value-added solutions to a wide variety of organizations. We highly believe in client satisfaction and ensure that we strive to provide consistent and improved performance. Web  :-     https://srimasassociate.com/bbmp-khata-transfer/
bbmp khata online Email Homepage
2024-1-8 18:57
Provides value-added solutions to a wide variety of organizations. We highly believe in client satisfaction and ensure that we strive to provide consistent and improved performance. Web  :-     https://srimasassociate.com/bbmp-khata-transfer/
buy shirt Email Homepage
2024-1-9 14:17
Shop the latest collection of premium cotton formal shirts for men online at kadhira. Choose from a range of luxury formal shirts and elevate your style effortlessly. Buy formal shirts online now.Web  :-      https://www.kadhira.com/collections/shirt
james Email
2024-1-10 22:03
MetaMask extension is one of the best decentralized crypto wallet browser extensions that prioritizes its user's anonymity and security. It was initially founded by Aaron Davis in 2016 and now it is operated by ConsenSys (a leading Ethereum software company). Today, the extension offers a wide range of functionalities to its users including purchasing, storage, sending, swapping, staking, and more.MetaMask Extension | MetaMask Extension
JACK Email
2024-1-11 16:33
Ethpool Staking offers a simplified approach to Ethereum staking. Users can delegate their Ethereum to a staking pool, earning staking rewards without the need for technical expertise.https://sites.google.com/cryptofinances.us/ethpool/homeLido Staking is a decentralized finance (DeFi) platform that enables users to participate in staking Ethereum (ETH) without the need for extensive technical knowledge or the lockup period typically associated with traditional staking. https://sites.google.com/cryptofinances.us/lidostaking/home
peacocktv.com/tv Email Homepage
2024-1-11 18:44
peacocktv.com/tv is one of the streaming services that many people around the world are interested in. NBC Widespread possesses Peacocktv.com/tv, the administrations offered incorporate many movies and Network programs open for streaming. A couple of the famous and most notable shows on the pop scene incorporate Works of art like the workplace and the cheers as well as current shows like Rule of peace and law and This Is Us.peacocktv.com/tv
daisylee Email Homepage
2024-1-16 16:54
paypal crypto wallet is a digital wallet provided by PayPal, a renowned online payment platform. It allows users to securely store and manage various cryptocurrencies, including Bitcoin, Ethereum, Bitcoin Cash, and Litecoin.https://sites.google.com/coinslogus.com/paypalcryptowallet/homecoinbase not working is a popular cryptocurrency exchange and wallet platform. If Coinbase is not working, it could be due to various reasons. Firstly, there might be technical issues or maintenance being conducted on the Coinbase platform.https://sites.google.com/coinslogus.com/coinbasenotworking/home
g Email Homepage
2024-1-16 18:12
Coinbase Login Unlock your crypto potential with confidence using Coinbase Login. Seamlessly manage assets, explore decentralized applications, and experience a secure and efficient login process.https://sites.google.com/coinslogus.com/coinbaselogin/homeMetaMask Extension simplifies your crypto experience by seamlessly integrating with your browser. Whether you're a seasoned crypto enthusiast or just starting your journey.https://sites.google.com/coinslogus.com/metamaskextension/home
Jadmason Email
2024-1-16 20:10
Crypto.com login issues If you're facing Crypto.com login issues, ensure your internet connection is stable, double-check your login credentials, and consider resetting your password. If problems persist, contact Crypto.com's customer support for assistance. paypal usdt  users to buy, sell, and hold USDT (Tether), a stablecoin pegged to the US dollar, within the platform. This provides users with a convenient way to engage in cryptocurrency transactions and manage their digital assets directly through their PayPal account.
missy Email Homepage
2024-1-17 11:37
https://sites.google.com/view/paypalemailloginus/https://sites.google.com/view/paypallogininusa/https://sites.google.com/view/paypallogininus/https://sites.google.com/view/paypalloginius/https://sites.google.com/view/paypalloginusn/home/https://sites.google.com/view/paypallogiinus/home/https://sites.google.com/view/paypallogin-iusa/https://printersetupshop.com/canon/https://mytv.peoypal.com/https://cuevana33.com/https://www.mcakey.com/https://sites.google.com/pypyi.com/paypallogin/home/https://epayoption.com/paypallogin/https://antivirus.mcakey.com/antivirus-support/https://sites.google.com/pypyi.com/amazonprime/home/https://www.mykashipur.com/paypal-change-to-business-account/
lucasleoo Email
2024-1-17 20:17
"PayPal Wallet is a digital wallet service facilitating online transactions. Users can store cards, link bank accounts, and make secure payments. It's widely used for e-commerce and peer-to-peer transactions.Coinbase Download To use Coinbase, visit the official website or download the app. Create an account, complete identity verification, and link a bank account to buy, sell, or trade various cryptocurrencies securely."
spa center Email Homepage
2024-1-21 12:48
Once you come to the website, it will be able to track your location automatically and suggest the best spa and massage centers in or near your area. Isn’t that the easiest way to find relaxation after a long day at work or spending a relaxing weekend?Web  :-     https://spalovers.in/
walter Email Homepage
2024-1-22 12:14
Phantom Wallet is a cutting-edge cryptocurrency wallet designed for the Solana blockchain. This user-friendly extension provides seamless access to decentralized applications (DApps) and facilitates secure storage and management of SOL tokens. With its intuitive interface and robust features, Phantom Wallet is a trusted choice for Solana enthusiasts worldwide.Phantom Wallet Extension | Phantom Extension
alvis
2024-1-22 18:38
As we know that the usage of MetaMask wallet involves going through different stages and completing different procedures, we'll first talk about its primary stage i.e. the procedure to download the MetaMask extension which would be followed by the procedure to sign up as well as logging in to the wallet. https://sites.google.com/metamaskgo.com/metamask-wallet/home
hazeljones Email
2024-1-22 23:20
Explore common problems and effective solutions to troubleshoot issues encountered on Telegram Web.Explore how to optimize and use Telegram Web on various browsers. Enhance your messaging experience effortlessly.https://sites.google.com/activatecoms.com/telegramweb/homehttps://sites.google.com/activatecoms.com/webtelegram/home
Jack Email
2024-1-23 14:17
Transform your online journey with Metamask Chrome, a pioneering browser extension that bridges the gap between traditional web browsing and the decentralized realm of blockchain. Empower yourself to securely manage cryptocurrencies.
分页: 411/433 第一页 上页 406 407 408 409 410 411 412 413 414 415 下页 最后页
发表评论
表情
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
emotemotemotemotemot
打开HTML
打开UBB
打开表情
隐藏
记住我
昵称   密码   游客无需密码
网址   电邮   [注册]