php-pm/php-pm

CLI process manager for modern Request-Response PHP Applications - with a builtin load-balancer.

Matthieu Napoli

@mnapoli

then I don't see where the memory leak is with PHP-PM if a process only handles one request

that's what you said above:

memory leaks only happen if the developer of a library/the application is not aware that the app is handling several request over linger time. php itself does t have issue with it

so if PHP-PM processes only handle 1 request no memory issue?

ahhhh nevermind!

and one process =one request is already what php-fpm is doing

I read that as php-pm

damn sorry!

Marc J. Schmidt

@marcj

php-pm itself has no memory leaks nor php has, but if your applications loads tons of services and never cleans up then you built memory leaks

Matthieu Napoli

@mnapoli

right

Marc J. Schmidt

@marcj

for example internal caches which could be useful for one process=one request use cases need to be resetted after each request in php-pm ( for example in the onTerminate event of symfony) but most user are not aware of this event

Matthieu Napoli

@mnapoli

yeah I definitely see what you mean

Marc J. Schmidt

@marcj

and thats how most memory leaks happen

Matthieu Napoli

@mnapoli

so do you think it would make sense to try to find a middleground between PHP-FPM and PHP-PM? Like this:

keep one process = one request (to simplify everything, avoid memory issues)
but keep the perf improvement by running the bootstrap before the process handles the request

?
I can see several options for how, but I want to make sure the premise is all right?

Marc J. Schmidt

@marcj

I tried hard but haven't found that golden way. the biggest improvement comes really when you work with php as you would with java where your whole apllication is in memory prepared waiting for incoming requests

Matthieu Napoli

@mnapoli

here are ideas, I have no idea if they are doable:

add a new feature in PHP-FPM so that PHP scripts can be run when PHP processes are spawned, until a special instruction that signals to PHP-FPM that the process is now fully initialized and can be added to the pool of PHP processes (i.e. an inverse of fastcgi_finish_request(), maybe like fastcgi_request_ready()) -> PHP-FPM stops the process and waits for a request -> when a request comes in, PHP-FPM populates the global variables ($_GET, etc.) and resumes the execution of the PHP script right were it stopped
implement a FCGI server (much like PHP-PM, that's why I'm asking you today) where the "LoadBalancer" process inits the framework, then loops for each incoming request -> on each request it forks -> the fork handles the request and then dies (1 process == 1 request), while the original process (LoadBalancer) waits for the next request

in both cases we keep one process == one request, but each process only handles 1 request so no memory issue (and we have the perf improvement because bootstrap is not part of the response time)

Matthieu Napoli

@mnapoli

I'm also wondering if there's a solution n°3 with pthreads, but I'll need to read more about that extension

Luke Rotherfield

@LRotherfield

Hi Guys, has anyone had any success running Oro Platform with php-pm?

Marc J. Schmidt

@marcj

@LRotherfield I don't think so

Luke Rotherfield

@LRotherfield

OK, fair enough, thanks for the response

kugu

@kugu

[www-data@sp-prod1 backend]$ composer.phar update
Loading composer repositories with package information
Updating dependencies (including require-dev)
Your requirements could not be resolved to an installable set of packages.

Problem 1

- php-pm/php-pm dev-master requires react/http dev-master#cd15204bd15d106d7832c680e4fb0ca0ce2f5e30 -> satisfiable by react/http[dev-master].
- php-pm/php-pm dev-master requires react/http dev-master#cd15204bd15d106d7832c680e4fb0ca0ce2f5e30 -> satisfiable by react/http[dev-master].
- Removal request for react/http == 9999999-dev
- Installation request for php-pm/php-pm dev-master -> satisfiable by php-pm/php-pm[dev-master].

kugu

@kugu

--- Worker 5501 stderr ---
PHP Fatal error: Class 'React\Http\RequestParser' not found in /git/backend.fb/vendor/php-pm/php-pm/React/RequestParser.php on line 8
Fatal Error: Class 'React\Http\RequestParser' not found in /git/backend.fb/vendor/php-pm/php-pm/React/RequestParser.php:8

part of the problem

current composer install/update - broken

Marc J. Schmidt

@marcj

yeah I guess they broke something

kugu

@kugu

dunno why, but it's installing latest version of react/http

where React\Http\RequestParser are deleted

Martin Lonský

@visitek

\React\Socket\Connection has bufferSize to default 4096... There is no way to set it to higher value... POST data is stripped now

$data = stream_socket_recvfrom($stream, $this->bufferSize);

We send json data, but is is truncated while it is bigger tahn 4096 :(

Martin Lonský

@visitek

Ohh.. it is not needed finally

data are emitted multiply ... incoming data are reading from stream by buffer size.. So before running app in handleRequest should be data collected with reflecting Content-Length

..solved, sorry

Jury

@lcjury

Hi, is php-pm still alive?

Franz Liedke

@franzliedke

@lcjury Yeah, big things are happening here right now: php-pm/php-pm#226

apocello2008

@apocello2008

Hello! I write issue about "Attempted to load class "AppKernel" from the global namespace." 2 weeks ago, but for now don't have any answers. Maybe somebody can help with this error?

apocello2008

@apocello2008

So, i trying setup basic app, based on PSR-7 and Zend\Stratigility. I repeat example from php-pm/php-pm-psr7 but i have error:

 Uncaught Symfony\Component\Debug\Exception\FatalThrowableError: Type error: Argument 2 passed to Zend\Stratigility\MiddlewarePipe::process() must be an instance of Interop\Http\ServerMiddleware\DelegateInterface, null given, called in php-pm/vendor/zendframework/zend-stratigility/src/MiddlewarePipe.php on line 86 in php-pm/vendor/zendframework/zend-stratigility/src/MiddlewarePipe.php:99

Pls. i need help =(

Adil Houmadi

@AdilHoumadi

Hello, is there any implementation of php-pm for apigility ?

Marc J. Schmidt

@marcj

@AdilHoumadi no, I don’t think so

Adil Houmadi

@AdilHoumadi

Is it possible to receive support questions ? I've run into problem for which I see no possible alternative.
I adapt the php-pm/php-pm-zend to use it with zend apigility, and it seems that the ppm cache requests. here is the output with adapted code
https://gist.github.com/AdilHoumadi/fbf28fe1361c4afc63564f16cdcc3220
Thanks in advance

Marc J. Schmidt

@marcj

@AdilHoumadi ppm does not cache stuff

vuliad

@vuliad

Hello. There are again breaking of composer (

is there any quick workaround now?

i see php-pm/php-pm#283 this was merged for future checkings (strange but ok..)

Richard Hagen

@Richard87

Hi guys! Do you have a recommandation for a replacement for StreamedResponse?
This is what I have now, and I think this is failing in PHP-PM:

    public function createResponse(FilesystemInterface $filesystem): StreamedResponse
    {
        $response = new StreamedResponse();
        $response->headers->makeDisposition(ResponseHeaderBag::DISPOSITION_INLINE,$this->getAsciiFilename());
        $response->headers->set("Content-Type",$this->getMimeType());
        $response->headers->set("Content-Length", $this->getSize());
        $response->setCallback(function () use ($filesystem) {
            $resource = $this->readStream($filesystem);
            fpassthru($resource);
            fclose($resource);
        });
        return $response;
    }

Marc J. Schmidt

@marcj

@Richard87 heyho, I don' think it should fail, it just doen't stream

Richard Hagen

@Richard87

@marcj Hmm, I get an "headers already sent" error when I return a StreamedResponse, and I can't imagine why...

Marc J. Schmidt

@marcj

@Richard87 oh mh, we don't have tests for that, so I don't know. Maybe StreamedResponse prints something to stdout directly

do you see where the output started in the "headers already sent" error?

Richard Hagen

@Richard87

Hi @marcj , thanks for answering :)
Here is the full stacktrace:

string(4217) "Symfony\Component\Debug\Exception\ContextErrorException: Warning: Cannot modify header information - headers already sent by (output started at /var/www/vendor/symfony/symfony/src/Symfony/Component/HttpFoundation/Response.php:1276) in /ppm/vendor/php-pm/httpkernel-adapter/Bridges/HttpKernel.php:231
Stack trace:
#0 /ppm/vendor/php-pm/httpkernel-adapter/Bridges/HttpKernel.php(101): PHPPM\Bridges\HttpKernel->mapResponse(Object(Symfony\Component\HttpFoundation\StreamedResponse))
#1 /ppm/vendor/php-pm/php-pm/src/ProcessSlave.php(406): PHPPM\Bridges\HttpKernel->handle(Object(React\Http\Io\ServerRequest))
#2 /ppm/vendor/php-pm/php-pm/src/ProcessSlave.php(367): PHPPM\ProcessSlave->handleRequest(Object(React\Http\Io\ServerRequest))
#3 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(52): PHPPM\ProcessSlave->onRequest(Object(React\Http\Io\ServerRequest), Object(Closure))
#4 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(48): React\Http\Io\MiddlewareRunner->call(Object(React\Http\Io\ServerRequest), 3)
#5 /ppm/vendor/react/http/src/Middleware/RequestBodyParserMiddleware.php(34): React\Http\Io\MiddlewareRunner->React\Http\Io\{closure}(Object(React\Http\Io\ServerRequest))
#6 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(52): React\Http\Middleware\RequestBodyParserMiddleware->__invoke(Object(React\Http\Io\ServerRequest), Object(Closure))
#7 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(48): React\Http\Io\MiddlewareRunner->call(Object(React\Http\Io\ServerRequest), 2)
#8 /ppm/vendor/react/http/src/Middleware/RequestBodyBufferMiddleware.php(44): React\Http\Io\MiddlewareRunner->React\Http\Io\{closure}(Object(React\Http\Io\ServerRequest))
#9 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(52): React\Http\Middleware\RequestBodyBufferMiddleware->__invoke(Object(React\Http\Io\ServerRequest), Object(Closure))
#10 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(48): React\Http\Io\MiddlewareRunner->call(Object(React\Http\Io\ServerRequest), 1)
#11 /ppm/vendor/react/http/src/Middleware/LimitConcurrentRequestsMiddleware.php(91): React\Http\Io\MiddlewareRunner->React\Http\Io\{closure}(Object(React\Http\Io\ServerRequest))
#12 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(52): React\Http\Middleware\LimitConcurrentRequestsMiddleware->__invoke(Object(React\Http\Io\ServerRequest), Object(Closure))
#13 /ppm/vendor/react/http/src/Io/MiddlewareRunner.php(40): React\Http\Io\MiddlewareRunner->call(Object(React\Http\Io\ServerRequest), 0)
#14 /ppm/vendor/react/http/src/StreamingServer.php(236): React\Http\Io\MiddlewareRunner->__invoke(Object(React\Http\Io\ServerRequest))
#15 /ppm/vendor/react/http/src/StreamingServer.php(178): React\Http\StreamingServer->handleRequest(Object(React\Socket\Connection), Object(React\Http\Io\ServerRequest))
#16 /ppm/vendor/evenement/evenement/src/Evenement/EventEmitterTrait.php(123): React\Http\StreamingServer->React\Http\{closure}(Object(React\Http\Io\ServerRequest), '')
#17 /ppm/vendor/react/http/src/Io/RequestHeaderParser.php(59): Evenement\EventEmitter->emit('headers', Array)
#18 /ppm/vendor/react/http/src/Io/RequestHeaderParser.php(47): React\Http\Io\RequestHeaderParser->parseAndEmitRequest(792)
#19 /ppm/vendor/evenement/evenement/src/Evenement/EventEmitterTrait.php(123): React\Http\Io\RequestHeaderParser->feed('GET /dashboard/...')
#20 /ppm/vendor/react/stream/src/Util.php(71): Evenement\EventEmitter->emit('data', Array)
#21 /ppm/vendor/evenement/evenement/src/Evenement/EventEmitterTrait.php(123): React\Stream\Util::React\Stream\{closure}('GET /dashboard/...')
#22 /ppm/vendor/react/stream/src/DuplexResourceStream.php(193): Evenement\EventEmitter->emit('data', Array)
#23 [internal function]: React\Stream\DuplexResourceStream->handleData(Resource id #2619, Object(React\EventLoop\StreamSelectLoop))
#24 /ppm/vendor/react/event-loop/src/StreamSelectLoop.php(236): call_user_func(Array, Resource id #2619, Object(React\EventLoop\StreamSelectLoop))

Where communities thrive

People

Repo info

Activity