o 3g@sXUdZddlmZddlZddlmZddlmZeeeZ e a de d<d d d Z dS) a EXPERIMENTAL! use with caution Manages 'global' ProcessPoolExecutor which is 'managed' by HPI itself, and can be passed down to DALs to speed up data processing. The reason to have it managed by HPI is because we don't want DALs instantiate pools themselves -- they can't cooperate and it would be hard/infeasible to control how many cores we want to dedicate to the DAL. Enabled by the env variable, specifying how many cores to dedicate e.g. "HPI_CPU_POOL=4 hpi query ..." ) annotationsN)ProcessPoolExecutor)castProcessPoolExecutor | None _INSTANCEreturncCsBtturtjd}|dust|dkrdatStt|datS)N HPI_CPU_POOLr) max_workers)r_NOT_SETosenvirongetintr) use_cpu_poolr+/home/garg/my-data/HPI/my/core/_cpu_pool.py get_cpu_pools r)rr) __doc__ __future__rr concurrent.futuresrtypingrobjectr r__annotations__rrrrrs