张宴的博客

PHP多进程并发控制的测试用例[原创]

Fri, 16 Nov 2007 06:32:30 +0000

　　[文章作者：张宴本文版本：v1.0 最后修改：2007.11.16 转载请注明出处：http://blog.zyan.cc]

　　最近遇到一个问题，Linux下的PHP命令行程序作为守护进程，需要从队列文件中读一行数据，通过TCP协议发送给外地的接收服务器，再读下一行数据，再发送。当本地与外地的网络状况不好时，有时候发送一条数据所耗费的时间就较长，累积起来容易造成队列堵塞和延迟。

　　于是，我准备用该PHP命令行程序生成多个子进程，将串行处理变成并行处理。最简单的方法就是在PHP中用exec()或popen()函数将一个shell命令行推到后台去执行，例如：

exec("/bin/sh /opt/zhangyan.sh &");
?>

　　最后的&表示将shell脚本推到后台去执行。

　　但是这样会有一个问题，如果推到后台的进程太多，可能会导致服务器系统资源耗尽而崩溃，所以必须控制进程数量。

　　我写了一个PHP程序（/opt/zhangyan.php）、一个shell程序（/opt/zhangyan.sh）作为测试用例。

　　程序的逻辑：
　　1、设置/opt/zhangyan.php最多允许生成500个子进程；
　　2、当/opt/zhangyan.php读取到一条数据后，将允许生成的子进程数减1（空闲进程数$p_number=500-1=499），然后将数据交给/opt/zhangyan.sh去后台处理，不等待/opt/zhangyan.sh处理结束，继续读取下一条数据；
　　3、当允许生成的子进程数减至0时（空闲进程数$p_number=0），/opt/zhangyan.php会等待1秒钟，然后检查后台还有多少个/opt/zhangyan.sh子进程尚未处理结束；
　　4、如果1秒钟之后/opt/zhangyan.php发现后台的/opt/zhangyan.sh子进程数还是500（空闲进程数$p_number=0），会继续等待1秒钟，如此反复；
　　5、如果/opt/zhangyan.php发现后台尚未处理结束的/opt/zhangyan.sh子进程数减少到300个了（空闲进程数$p_number=500-300=200），那么/opt/zhangyan.php会再往后台推送200个/opt/zhangyan.sh子进程；

............

Tags - linux , php

[评论] PHP多进程并发控制的测试用例[原创]

Fri, 16 Nov 2007 06:53:01 +0000

很好，很强大，
很喜欢你的程序。。。尤其是APMServ。
不过遗憾的是你的APMServ到2.0版就没动静了呀。
现在PHP5出了5.2.5了，修改了很多Bug。。
MySQL也出了5.0的新版了，应该会有改进吧。。
Apache貌似也更新了一些东东。。。
不知道你是否会把APMServ继续更新下去，期待你的新作。。。

[评论] PHP多进程并发控制的测试用例[原创]

Fri, 16 Nov 2007 08:46:53 +0000

博主你使用什么数据库啊?
想用您哪个编译的方法安装带PDO和PDO_ibm的nginx服务器，不知道如何下手。

可否抽空实验一下啊？

感谢

[评论] PHP多进程并发控制的测试用例[原创]

Sat, 17 Nov 2007 02:52:09 +0000

建议你先出个过渡版本的APMServ，把Apache、PHP5、MySQL，phpMyAdmin等模块更新至最新版本，至于APMServ.exe这个程序如果没时间的话，那些尚未完成的功能在以后再添加。
毕竟新版的Apache、PHP5、MySQL修补了很多的漏洞和Bug。
个人愚见，希望你考虑一下。。

[评论] PHP多进程并发控制的测试用例[原创]

Fri, 25 Jan 2008 05:00:28 +0000

博主尝试过stream_select()吗？据说可以实现进程的并发。

[评论] PHP多进程并发控制的测试用例[原创]

Mon, 26 May 2008 17:33:17 +0000

进程内实现事件驱动模型可以很好的解决这个问题。
fastcgi的工作机制就是那样。

当然现在的解决方法非常的简洁，不过也容易出现问题，呵呵。

[评论] PHP多进程并发控制的测试用例[原创]

Tue, 17 Nov 2009 08:15:41 +0000

我觉得用纯PHP的解决方案 pcntl 控制线程更加的完美。
最好，不要每次启动一个进程，然后关闭一个进程。让500个进程常驻内存进行发送，
但是，这样的话，可能控制并发比较麻烦点。

[评论] PHP多进程并发控制的测试用例[原创]

Thu, 21 Oct 2010 03:37:08 +0000

张大哥我做了一个php来执行 .sh脚本，但是通过php来执行.sh脚本会产生一个假死进程，而在服务器上执行该.sh脚本是没问题的php 是用nobody权限nobody 已经在 /etc/sudoers 中添加了.sh脚本中所要执行的程序目录。不知是怎么回事了

[评论] PHP多进程并发控制的测试用例[原创]

Tue, 07 Dec 2010 03:07:04 +0000

你好，请教一下：可以用php 来执行 php 脚本吗？也就是把你的zhangyan.sh 用一个php 的脚本zhangyan.php代替？

[评论] PHP多进程并发控制的测试用例[原创]

Mon, 17 Jan 2011 10:36:40 +0000

可以，使用exec

[评论] PHP多进程并发控制的测试用例[原创]

Thu, 17 May 2012 03:15:12 +0000

Today, following half a century, mentor leather-bases coach factory outlet continues to be the delicate craft of leather-based master is accountable for,Would you like to meet more friends, or go with the times? If yes, coach factory online is opening welcome doors to you.in the market you definitely can find various colorways that are designed in as well as the high quality that applied in. For most of you would like to come. So just come to our coach factory outlet online store to choose one.

[评论] PHP多进程并发控制的测试用例[原创]

Thu, 17 May 2012 03:15:19 +0000

Louis Vuitton belt at louis vuitton sale is one kind of fashion accessory with high cost performance among the Louis Vuitton accessories.Offering quality LV products with favorable prices, louis vuitton outlet store is at your service. Hurry up, or you can not seize the chance.in fact, louis vuitton is one of the most famous fashion design master.he opened the fist suitcase shop called after his name.

[评论] PHP多进程并发控制的测试用例[原创]

Thu, 17 May 2012 03:15:25 +0000

I heard of coach outlet online through the advertisement when I was shopping. And now I often brow the webpage and buy Coach bags online.It is a symbol regarding position not to mention nature.Here I would like to launch a excellent bags pertaining to business men.Which may be coach outlet store.coach outlet has always been simple,durable style features to win consumers.The products are more flexible,with easy bleaching,wear characteristics,and simply use a damp cloth.

[评论] PHP多进程并发控制的测试用例[原创]

Thu, 17 May 2012 03:15:35 +0000

Remember the coach outlet provide coach bags which won't be deteriorated into its overall styles by any means. It will maintain its looks, colors, and uniqueness for long time.coach outlet store online has been voted by Hour Detroit magazine readers as the Best of Detroit in their 12th annual readers'poll.Lots of women like which usually amount normally include a coach outlet online ,it provides coziness to many girls that don't even think it is a great bushel of great interest directly to them.

[评论] PHP多进程并发控制的测试用例[原创]

Fri, 18 May 2012 08:35:17 +0000

We aim to make all our customers satisfy with our products. You will find a variety of Men's fashion louis vuitton uk, fashion Women's cheap Louis Vuitton bags in our store at affordable price.Thinking of interesting ways to cost a milestone birthday? louis vuitton online shop had one of the most distinctive distinctive celebrations.bakery along with living room operated by means of about three moment louis vuitton online Most effective Pastry Chef’s of the year Rammy Nominee Chef’s.

[评论] PHP多进程并发控制的测试用例[原创]

Fri, 18 May 2012 08:35:25 +0000

The choices are likely to be basically countless seeing that louis vuitton outlet occurs with the help of completely new and also incredible concepts once in a while.Louis vuitton Wholesale Monogram Canvas HandbagsLouis Vuitton Collection Beach Handbags louis vuitton bags outlet Damier Canvas HandbagsLouis vuitton Mahina HandbagsLouis Vuitton Monogram Mini Lin HandbagsLouis Vuitton Monogram Multicolore HandbagsLouis vuitton Monogram Vernis HandbagsLouis Vuitton Wholesale Epi Leather HandbagsLouis Vuitton For Men HandbagsLouis Vuitton Damier Canvas WalletsLouis Vuitton Epi Leather WalletsLouis Vuitton Monogram Canvas WalletsLouis Vuitton Monogram Vernis WalleLouis Vuitton ShoesLouis Vuitton Men wallets.As the Authentic Louis Vuitton are so high-priced, so came the louis vuitton handbags outlet.