o hxAhG@s ddlZddlZddlZddlmZmZddlZddlZddlZddl m Z m Z m Z m Z eeeZz ddlmZmZWneyMedYnwe deddZd ed eeeeeffd d Zd ed eeeeeffd dZejddgdddZdS)N)OptionalTuple) Blueprintrequestjsonify current_app)async_playwrightErrorzbERROR: Playwright is required. Install with: pip install playwright && playwright install chromium twitter_utilsz/twitter) url_prefixusernamereturnc"s td|d|}td|t4IdH}d}zxztd|d|jjdgdd IdH}td |du|jd d d ddddddddIdH}td|IdH}|dIdHtdtd|d|j|dddIdHtd|dd}d }d!}d"} t |D]^} td#| d$d%|d&| IdH} | st d'| |d$krt |IdHq| }d(|vr+td)| d$d*z/|d(} td+| d,} tt|| td(d,}|| |}td)| d$d-|dWn+ty*}zt d)| d$d.|WYd}~nd}~wwtd)| d$d/d0}t||}td)| d$d1||r|d$d2d3}|d4}td5| d$d6|d7|d8d} ||fWW|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHSd?}t||}td)| d$d@||rh|d$}td5| d$dA|dBdCt|dD}t||}|r|d$d2d3nd}|rtdE|ntdFd} ||fWW|rTztd9|IdHtd:WntyS}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHSgdG}|}|D]d}||vrt d)| d$dH|dId} WW|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHdJSqr| |d$krtd)| d$dKt |IdHqt dL| q| stdM|sUt dNWW|rAztd9|IdHtd:Wnty@}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHdJStdOt|}tdP|dQ|d|dR|vrvtdSntdTd}d}dUdVdWdXdYdZd[}|D]\}}d} |d\krt||}!|!rtd]|!dd^|!d+}td_|d|fWW|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHSnt||} | rstd`|da| d$| d$}d|fWW|r_ztd9|IdHtd:Wnty^}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHSq|ry t db|d>WW|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHdJSty3}z[tjdc|dd|dd<WYd}~W|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHdJSd}~wty}z[tjde|dd|dd<WYd}~W|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>WdIdHdJSd}~ww|rztd9|IdHtd:Wnty}ztjd;|dd<WYd}~nd}~wwtd=|d>w1IdHswYdS)fz Fetch a Twitter/X user profile, find the cover image URL, and extract the Twitter ID. This is the asynchronous version for use with Playwright. z4[TWITTER_UTILS] Attempting to get profile info for: zhttps://x.com/z[TWITTER_UTILS] Profile URL: Nz&[TWITTER_UTILS] Launching browser for z...T) z --no-sandboxz--disable-setuid-sandboxz---disable-blink-features=AutomationControlledz--disable-web-securityz--disable-dev-shm-usagez --disable-gpuz--no-first-runz--no-default-browser-checkz--disable-default-apps)headlessargsz"[TWITTER_UTILS] Browser launched: ii8)widthheightzoMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36zJtext/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8zen-US,en;q=0.5z gzip, deflatez keep-alive1)AcceptzAccept-LanguagezAccept-Encoding ConnectionzUpgrade-Insecure-Requests)Zviewport user_agentZextra_http_headersz([TWITTER_UTILS] Browser context created.zEObject.defineProperty(navigator, 'webdriver', {get: () => undefined})z![TWITTER_UTILS] New page created.z[TWITTER_UTILS] Navigating to Z networkidleiȯ)Z wait_untiltimeoutz[TWITTER_UTILS] Navigation to z completed using networkidle. g?Fz [TWITTER_UTILS] Polling attempt /z for content...z?[TWITTER_UTILS] No HTML content fetched during polling attempt.zpbs.twimg.com/profile_banners/z[TWITTER_UTILS] Poll z3: Substring 'pbs.twimg.com/profile_banners/' FOUND.rdz&: Context sample around substring: ...z : Error logging context sample: z7: Substring 'pbs.twimg.com/profile_banners/' NOT FOUND.zkbackground-image:\s*url\((?:"|")?(https://pbs\.twimg\.com/profile_banners/(\d+)/[^)]+?)(?:"|")?\)z%: Style_banner_pattern match result: z&&z [TWITTER_UTILS] SUCCESS in Poll z : Found ID 'z' and Cover URL 'z' via STYLE pattern.z"[TWITTER_UTILS] Closing browser...z[TWITTER_UTILS] Browser closed.zI[TWITTER_UTILS] Error closing browser in get_twitter_profile_info_async: exc_infoz;[TWITTER_UTILS] Exiting get_twitter_profile_info_async for .z1https://pbs\\.twimg\\.com/profile_banners/(\\d+)/z(: Original banner_pattern match result: z: Found Twitter ID 'z' via ORIGINAL banner pattern.z+(https://pbs\\.twimg\\.com/profile_banners/z/\\d+/\\d+x\\d+)z8[TWITTER_UTILS] Found cover image for original pattern: zL[TWITTER_UTILS] Cover image URL not found for original pattern (ID present).)zthis account doesn't existzhmm...this page doesn't existzpage not foundzaccount suspendedz": Profile error indicator found: ''NNz(: Primary conditions not met. Waiting...zG[TWITTER_UTILS] Max polling attempts for banner reached. found_in_poll=zu[TWITTER_UTILS] Primary banner/error not found during polling. Trying alternative patterns on last fetched content...zO[TWITTER_UTILS] HTML content is empty after polling loop, cannot try fallbacks.iz1[TWITTER_UTILS] HTML sample for fallbacks (first z chars): Zprofile_bannerszH[TWITTER_UTILS] 'profile_banners' string IS in final HTML for fallbacks.zI[TWITTER_UTILS] 'profile_banners' string NOT in final HTML for fallbacks.z"rest_id":"(\d+)"zdata-user-id="(\d+)"z"id_str":"(\d+)"z"user_id":"(\d+)"zprofile_images/(\d+)/z "(\d{15,19})")Zrest_idz data-user-idZid_strZ user_id_jsonZprofile_imageslong_numeric_idr#z<[TWITTER_UTILS] Found potential Twitter IDs (15-19 digits): zG[TWITTER_UTILS] Using first potential Twitter ID from long_numeric_id: z6[TWITTER_UTILS] Found match with alternative pattern 'z': z@[TWITTER_UTILS] All primary and alternative patterns failed for zG[TWITTER_UTILS] Playwright error in get_twitter_profile_info_async for : zG[TWITTER_UTILS] Unexpected error in get_twitter_profile_info_async for )loggerinforZchromiumlaunch new_contextZnew_pageZadd_init_scriptZgotorangecontentwarningasynciosleepfindmaxminlen ExceptionresearchgroupreplacecloseerrorescapeloweritemsfindallPlaywrightError)"r Z profile_urlpbrowsercontextpageZmax_polling_attemptsZpolling_interval_secondsZ html_contentZ found_in_pollattemptZcurrent_html_contentidx start_idxZend_idxZcontext_sampleeZstyle_banner_patternZ style_matchcover_image_url twitter_idZbanner_patternmatchZfull_banner_url_patternZ full_matchZerror_indicatorsZhtml_content_lowerZ indicatorZ sample_lengthZpatterns_to_tryname pattern_regexZ current_matchZ possible_idsrL3/var/www/html/brandlife/blueprints/twitter_utils.pyget_twitter_profile_info_asyncs&          &  "k  ^    X  q J  y  ;          )    3   @   C   C  rNcstddgfdd}tj|d}||tdddtdtr@tdd kr@dSt d d dd dS) Nz+[TWITTER_UTILS_THREAD] Starting thread for r"c s$tddzzttd<tdddWnEtyE}ztjdd|dd d d<WYd}~n2d}~wtyg}ztjd d|dd d d<WYd}~nd}~wwWtd dSWtd dSWtd dStd w) Nz1[TWITTER_UTILS_THREAD] Thread target running for z (with nest_asyncio)rzT[TWITTER_UTILS_THREAD] Async task completed via asyncio.run() with nest_asyncio for z . Result: z9[TWITTER_UTILS_THREAD] RuntimeError in thread target for z (with nest_asyncio): Trr"z>[TWITTER_UTILS_THREAD] General Exception in thread target for z2[TWITTER_UTILS_THREAD] Thread target finished for )r&r'r-runrN RuntimeErrorr9r3)rFresult_containerr rLrMtargets&&z#run_async_in_thread..target)rSz"[TWITTER_UTILS_THREAD] Thread for z& joined. Final result from container: rrz,[TWITTER_UTILS_THREAD] Result container for z+ did not contain a valid tuple. Contained: z. Returning (None,None).) r&r' threadingThreadstartjoin isinstancetupler2r,)r rSthreadrLrQrMrun_async_in_threads r[z/get_id/GET)methodsc Cstd||stdtddidfSzBt|\}}td|d|d||rDtd |d |t|||d d fWStd |dtdd|didfWSty}ztjd|d |ddtdt|ddfWYd}~Sd}~ww)z Flask endpoint to get Twitter ID and cover image URL. Uses a separate thread to run the async Playwright code to avoid event loop conflicts. z-[TWITTER_ROUTE] Received request for /get_id/z.[TWITTER_ROUTE] Username parameter is missing.r9zUsername parameter is requirediz4[TWITTER_ROUTE] Result from run_async_in_thread for z : twitter_id=z , cover_url=z6[TWITTER_ROUTE] Successfully retrieved Twitter ID for r%)r rHrGz2[TWITTER_ROUTE] Failed to retrieve Twitter ID for z%. Playwright function returned no ID.z#Could not retrieve information for zB. Playwright function might have failed silently or found no data.iz*[TWITTER_ROUTE] Error in get_id_route for Trz!An internal server error occurred)r9detailsiN)r&r'r,rr[r3r9str)r Z cover_urlrHrFrLrLrM get_id_routes.  "ra)r-r4systypingrrrTloggingZ nest_asyncioflaskrrrrapply getLogger__name__r&Zplaywright.async_apirr r> ImportErrorr9 twitter_bpr`rNr[routerarLrLrLrMs*  ""Z