PHP Gearman too much mysql connections -

-

i'm using gearman in custom joomla application , using gearman ui track active workers , jobs number.

i'm facing issue mysql load , number of connections, i'm unable track issue, i've few questions might me.

1- gearman workers launch new database connection each job or share same connection?

2- if gearman launches new connection everytime job runs how can change make jobs share same connection?

3- how can balance load between more 1 server?

4- there "pay-as-you-go" package mysql hosting? if yes, please mention them.

thanks lot!

this overlooked issue when using kind of job queue workers. 100 workers open separate database connection each (they separate php processes). if mysql configured allow 50 connections, workers start failing. answer questions:

1) each worker runs inside 1 php process each, , process open 1 database connection. workers not share database connections.

2) if 1 worker processing jobs, 1 database connection opened. if have 50 workers running, expect 50 database connections. since these not web requests, persistent connections not work, sharing not work.

3) can balance load adding read slaves, , using mysql proxy distribute load.

4) i've never seen pay-as-you-go mysql hosting solution. ask provider increase number of connections. if won't, might time run own server.

also, gearman server process use 1 database connection maintain queue (if have enabled mysql storage).

strategies can use try , make worker code play nicely database:

  1. after each job, terminate worker , start again. don't open new database connection until new job received. use supervisor keep workers running time.

  2. close database connections after every query. if see lot of connections open in 'sleep' state, clean them , keep database connections low. try $pdo = null; after each query (if use pdo).

  3. cache used queries result doesn't change, keep database connections low.

  4. ensure tables indexed queries run fast possible.

  5. ensure database exceptions caught in try/catch block. add retry logic (while loop), worker fail gracefully after say, 10 attempts. make sure job put on queue after failure.


Comments

Post a Comment

Popular posts from this blog

php - How to display all orders for a single product showing the most recent first? Woocommerce -

-
i have password protected page on frontend. on page, want display full list of purchases associated single woocommerce product id. option 1: i've looked through woocommerce docs , , found: wc_cli_order , list_( $args, $assoc_args ) function lists orders. presumably, orders can filtered product id [--=] filter orders based on order property. line item fields (numeric array, started index zero): line_items.0.product_id option 2: i found article , based on customer id. i've modified code based on guesses meta_key , meta_value. $customer_orders = get_posts( array( 'numberposts' => -1, 'meta_key' => '_product', 'meta_value' => get_product_id(), 'post_type' => wc_get_order_types(), 'post_status' => array_keys( wc_get_order_statuses() ), ) ); how display orders single product showing recent order first? here solution put based on these articles: http://www.w...
Read more

asp.net - How to correctly use QUERY_STRING in ISAPI rewrite? -

-
i'm having difficult time , hope guys can help. using helicon isapi rewrite version 3.1.0.104 on our iis server. edit http.conf file , have tried , still fail. this trying do: redirect url: https://www.domain.com/switch-by-version?version=2.8.5.2594 to: https://test.domain.com/load/load.aspx?tver=2.8.5.2594 the version number @ end source url change, , need target url have same version number @ end of url example above shows. i tried following not work: rewritecond %{query_string} ^version=(\d\d?)\.(\d\d?)\.(\d\d?)\.(.*)$ [nc] rewriterule ^/switch-by-version(.*)$ https://test.domain.com/load/load.aspx?tver=%1 [r=307,nc,l] any appreciated! thanks. if it's running in equivalent context of .htaccess , rule shouldn't start / . here's simpler version: rewritecond %{query_string} ^version=(\d+\.\d+\.\d+(?:\..+)?)$ [nc] rewriterule ^switch-by-version/?$ https://test.domain.com/load/load.aspx?tver=%1 [r=307,nc,l]
Read more

angularjs - How restrict admin panel using in backend laravel and admin panel on angular? -

-
https://scotch.io/tutorials/token-based-authentication-for-angularjs-and-laravel-apps following tutorials, try write authentication restrict admin panel, didn't understood how can that. this admin panel, admin panel don't want show , request database unauthenticated users. my laravel-routes route::get('/admin',function(){ return view('index'); }); route::get('/api/v1/employees/{id?}', 'employees@index'); route::get('/api/v1/users/{id?}', 'employees@users'); route::post('/api/v1/employees', 'employees@store'); route::post('/api/v1/employees/{id}', 'employees@update'); route::delete('/api/v1/employees/{id}', 'employees@destroy'); route::group(['prefix' => 'api'], function() { route::resource('authenticate', 'authenticatecontroller', ['only' => ['index']]); route::post('authenticate', 'authentic...
Read more