google app engine - python: Leaking memory when looping through user-list -


i have sort of memory leakage in program. made a previous post code-snippet more streamlined.

it fetches 100 users per loop; got ~6000 users.

def sync_users():   api = api()#class handling api-request - no leak   maxresults = 100   page_token = ""   user  = none   users = none   while true:     gc.collect()     logging.debug(memory_usage().current())     users = api.user_list(maxresults=maxresults, pagetoken=page_token)     if "users" not in users:       break     user in users["users"]:       deferred.defer(sync_user, user)     if "nextpagetoken" in users:       page_token = users["nextpagetoken"]     else:       break

i ran paused task-queue no other task ran in parallel. memory-log. 

    92.703125     92.70703125     93.81640625     94.80859375     96.2109375     97.3515625     98.75     99.71484375     101.1796875     102.44140625     103.5     ...     150.25390625     151.2421875

memory usage grows linearly , ends with: exceeded soft private memory limit of 128 mb 153 mb after servicing 5586 requests total

sometimes manage finish before memory runs out; it's not infinite loop.


Comments

Post a Comment

Popular posts from this blog

php - Wordpress website dashboard page or post editor content is not showing but front end data is showing properly -

Image
recently have uploaded wordpress site onto server. have uploaded wordpress site in sub-folder under root folder ../root(domain root folder)/wordpress (where host wordpress folder). now problem content data in page or post in dashboard of wordpress admin panel not showing - see image. but data showing in front view - see image. if not browser cache issue , not issue happened tinymce editor during upgrade; try add config file: define('concatenate_scripts', false);
Read more

javascript - Get parameter of GET request -

i make request: createxhrrequest( "get", fileurl, function( err, response ) { if( err ) { alert( "error get!" ); } alert(response); }); and full response: { "status" : "ok", "message" : "jvberi0xljqkjdduxdgkmy how can jvberi0xlj ? i try response.message , response["message"]. nothing works. just simple access this: var json = json.parse(response); json.message
Read more

javascript - Twitter Bootstrap - how to add some more margin between tooltip popup and element -

Image
i have not tryed since can't understand space between tooltip , element made/added bootstrap, tooltip near element triggers tooltip event. i make tooltip opening little bit away element, add more margin tooltip , eleemnt mean. i understand how in css if possible , if possible make both right,left,top,bottom tooltips hope question clear. this how tooltips looks on app: and , how should looks after this default css tooltip on top : .tooltip.top { padding: 5px 0; margin-top: -3px; } you can override in own css : .tooltip.top { margin-top: -10px; } note code work work tooltip on top, you'll nedd adapt css 3 other orientations : .tooltip.top { margin-top: -10px; } .tooltip.right { margin-left: 10px; } .tooltip.bottom { margin-top: 10px; } .tooltip.left { margin-left: -10px; }
Read more