KixUddlZddlZddlmZmZddlmZmZmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZmZddlZddlmZddlmZddlmZdd l m!Z!dd l"m#Z#dd l$m%Z%d d l&m'Z'd dl&m(Z(d dl&m)Z)d dl&m*Z*d dl+m,Z,d dl-m.Z.d dl/m0Z0d dl1m2Z2m3Z3d dl4m5Z5m6Z6m7Z7m8Z8m9Z9d dl:m;Z;mZ>m?Z?ejeAZBejeDd<ejeAZFejeDd<GddeZHedZIedZJee3ZKeLZMeLZNeOeLeLfZPeeQeNePfZReQeMeRfZSeeSZTGddeZUGdd e(ZVy)!N)AsyncExitStackasynccontextmanager)datetime timedeltatimezone) TracebackType) AsyncGenerator AwaitableCallableHashableIterableMapping ParamSpecProtocolSequence TypedDictTypeVarcastoverload) AsyncKeyValue)trace)Redis)PubSub) RedisCluster)Self)DocketSnapshot)DocketSnapshotMixin)RunningExecution) WorkerInfo)RedisConnection) ResultStorage)uuid7) Execution TaskFunction) TASKS_ADDEDTASKS_CANCELLEDTASKS_REPLACEDTASKS_SCHEDULEDTASKS_STRICKEN)LiteralOperatorOperatorRestoreStrike StrikeListloggertracerc,eZdZdeedeedefdZy) _cancel_taskkeysargsreturnc KywN)selfr4r5s Y/home/jay/workspace/scripts/.codegraph-venv/lib/python3.12/site-packages/docket/docket.py__call__z_cancel_task.__call__=s N)__name__ __module__ __qualname__liststrr<r9r;r3r3<s'I%)#Y rCr3PRc6eZdZUeed<eed<eed<eed<y)RedisStreamPendingMessage message_idconsumertime_since_deliveredtimes_deliveredN)r>r?r@bytes__annotations__intr9rCr;rGrGOsOrCrGceZdZUdZeeefed<eed<e ed<e dzed<e dzed<e ed<d d e d d e dddfdedede dede dedzdeddfdZedefdZedefdZdedefdZdefdZdeedzd edzd!edzddfd"Zedeeezdffd#Z edee!dffd$Z"d%ed&edefd'Z#dNd(ed)e$edzddfd*Z%d+eddfd,Z&de'eeffd-Z(e) dOd(e*e+e,e-fd.e.dzd/edzde*e+e,e/ffd0Z0e) dOd(ed.e.dzd/edzde*d1e,e/ffd2Z0 dOd(e*e+e,e-fezd.e.dzd/edzde*d1e,e/ffd3Z0e)d(e*e+e,e-fd.e.d/ede*e+e,e/ffd4Z1e)d(ed.e.d/ede*d1e,e/ffd5Z1d(e*e+e,e-fezd.e.d/ede*d1e,e/ffd6Z1d7e/ddfd8Z2d/eddfd9Z3d/ede/dzfd:Z4edefd;Z5edefd<Z6d=edefd>Z7d=edefd?Z8d=edefd@Z9d=edefdAZ:d=edefdBZ;edefdCZ dQd(e*e+e,e-fezdzdGedzdHe?e@zdIeAdzddf dJZB dQd(e*e+e,e-fezdzdGedzdHe?e@zdIeAdzddf dKZCdPdLZDdefdMZEy)RDocketaA Docket represents a collection of tasks that may be scheduled for later execution. With a Docket, you can add, replace, and cancel tasks. Example: ```python @task async def my_task(greeting: str, recipient: str) -> None: print(f"{greeting}, {recipient}!") async with Docket() as docket: docket.add(my_task)("Hello", recipient="world") ``` tasks strike_list_redisN_result_storage_cancel_task_script_stackdocketzredis://localhost:6379/0)seconds)minutesFnameurlheartbeat_intervalmissed_heartbeats execution_ttlresult_storageenable_internal_instrumentationr6c||_||_||_||_||_||_d|_||_t||_ ddl m }|D cic]} | j| c} |_ ycc} w)a  Args: name: The name of the docket. url: The URL of the Redis server or in-memory backend. For example: - "redis://localhost:6379/0" - "redis://user:password@localhost:6379/0" - "redis://user:password@localhost:6379/0?ssl=true" - "rediss://localhost:6379/0" - "unix:///path/to/redis.sock" - "memory://" (in-memory backend for testing) heartbeat_interval: How often workers send heartbeat messages to the docket. missed_heartbeats: How many heartbeats a worker can miss before it is considered dead. execution_ttl: How long to keep completed or failed execution state records in Redis before they expire. Defaults to 15 minutes. enable_internal_instrumentation: Whether to enable OpenTelemetry spans for internal Redis polling operations like strike stream monitoring. Defaults to False. Nr)standard_tasks) r]r^r_r`rarcrU_user_result_storager!rSrQrer>) r:r]r^r_r`rarbrcrefns r;__init__zDocket.__init__msn: "4!2*/N,#' $2!%c* )IW.X2r{{B.X .XsA0cy)Nzdocket-workersr9r:s r;worker_group_namezDocket.worker_group_namesrCcL|jj|jS)zReturn the key prefix for this docket. All Redis keys for this docket are prefixed with this value. For Redis Cluster mode, returns a hash-tagged prefix like "{myapp}" to ensure all keys hash to the same slot. )rSprefixr]rjs r;rmz Docket.prefixs{{!!$)),,rCsuffixc$|jd|S)zReturn a Redis key with the docket prefix. Args: suffix: The key suffix (e.g., "queue", "stream", "runs:task-123") Returns: Full Redis key like "docket:queue" or "docket:stream" :)rm)r:rns r;keyz Docket.keys++ax((rCc^Kt_jjd{tjj j _jjjd{jjjd{jRj_ d_ tjdr"jjd{Stjj _ jjjd{jj#fdj_ S7q7777?w)N)r^r]rcsetupctddS)NrT)setattrrjsr;z#Docket.__aenter__..s7H$)OrC)rrV __aenter__r/r^r]rcrRenter_async_contextrSrfrbrThasattrrsr"results_collectioncallbackrjs`r;rwzDocket.__aenter__sZ$& kk$$&&&%,0,P,P kk--dkk:::kk--d.>.>???  $ $ 0151J1JD #'D t**G4))//111  $1d>U>U#VD ++11$2F2FG G G KK !O P"&"6"6D  5 ' ; @2 HsZ-F-F!AF-F$,F-;F'A<AA A>AAAA AAcK|jj4d{}|dddd{y77#1d{7swYyxYwwr8)rSpubsub)r:rs r;_pubsubzDocket._pubsubsL;;%%'  6L       rchannelmessagecVK|jj||d{S7w)a7Publish a message to a pub/sub channel. This handles both standalone and cluster modes transparently. Args: channel: The pub/sub channel to publish to message: The message to publish Returns: Number of subscribers that received the message N)rSpublish)r:rrs r;_publishzDocket._publishs%[[(('::::s )')functionnamescjddlm}|||s |jg}|D]}||j|<y)zRegister a task with the Docket. Args: function: The task to register. names: Names to register the task under. Defaults to [function.__name__]. r)validate_dependenciesN) dependenciesrr>rQ)r:rrrr]s r;registerzDocket.registers= 8h'&&'E (D'DJJt  (rCcollection_pathc|jd\}}}tj|}t||}|D]}|j |y)z Register a collection of tasks. Args: collection_path: A path in the format "module:collection". rpN) rpartition importlib import_modulegetattrr)r:r module_name_ member_namemodule collectionrs r;register_collectionzDocket.register_collectionsR'6&@&@&E# Q ((5V[1 " $H MM( # $rCcd|jiS)Nz docket.name)r]rjs r;labelsz Docket.labelss 499  rCwhenrqcy)zAdd a task to the Docket. Args: function: The task function to add. when: The time to schedule the task. key: The key to schedule the task under. Nr9r:rrrqs r;addz Docket.addrC.cy)zAdd a task to the Docket. Args: function: The name of a task to add. when: The time to schedule the task. key: The key to schedule the task under. Nr9rs r;rz Docket.add%rrCcNdttrjnj#t j t jttdtjdtjdtffd }|S)zAdd a task to the Docket. Args: function: The task to add. when: The time to schedule the task. key: The key to schedule the task under. Nr5kwargsr6c Kt||d}tjdij|j d|j i5j j|rptjd|j |jtjdij|jddi|cdddS|jd d{dddtjdij|jt!jdij|j|S7z#1swYyxYww) Nrattempt function_namez docket.addcode.function.name attributes'%r is stricken, skipping schedule of %r docket.whererWFreplace)r$r1start_as_current_spanrspecific_labelsrrR is_strickenr0warningrqr*rgeneral_labelsscheduler&r)r5r executionrrrqr:rs r; schedulerzDocket.add..schedulerNs!+ I--kkm//1))*A*A. 8##// :NNA!//!  #&&"kkm'668+H%/ 8 84 (((7775 88 OOAN$++-N93K3K3MN O   #Rdkkm#Ry7O7O7Q#R S  85 8 8s>AFBE: F(E:=E8>E:A6F8E::F?F) isinstancerBrQrrnowrutcr#rDr5rr$r:rrrqrrs```` @r;rz Docket.add4s%) h $$Mzz(+H MM( # <<< -D ;eg,C+ 166+ QXX+ )+ + ZrCcy)zReplace a previously scheduled task on the Docket. Args: function: The task function to replace. when: The time to schedule the task. key: The key to schedule the task under. Nr9rs r;rzDocket.replace}rrCcy)zReplace a previously scheduled task on the Docket. Args: function: The name of a task to replace. when: The time to schedule the task. key: The key to schedule the task under. Nr9rs r;rzDocket.replacerrCcdttrjnjdtj dtj dtffd }|S)zReplace a previously scheduled task on the Docket. Args: function: The task to replace. when: The time to schedule the task. key: The key to schedule the task under. Nr5rr6c |Kt||d}tjdij|j d|j i5j j|rptjd|j |jtjdij|jddi|cdddS|jd d{dddtjdij|jt!jdij|jt#jdij|j|S7#1swYxYww) Nrrzdocket.replacerrrrrWTr)r$r1rrrrrRrr0rrqr*rrrr(r'r)rs r;rz!Docket.replace..schedulers!+ I-- kkm//1))*A*A. 7##// :NNA!//!  #&&"kkm'668+H%/ 7 74 (((6665 78   q"QT[[]"Qi6N6N6P"Q R   #Rdkkm#Ry7O7O7Q#R S   #Rdkkm#Ry7O7O7Q#R S  75 7 7s>AF<BF0 F<(F0=F.>F0B,F<.F00F95F<)rrBrQrrDr5rr$rs```` @r;rzDocket.replacesc%) h $$Mzz(+H MM( #, 166, QXX, ), , \rCrcxKtjdi|j|jd|ji5|j j |rotjd|j|jtjdi|j|jddi dddy|jd d{dddtjdi|j|jy7C#1swYBxYww) Nzdocket.schedulerrrrrrWFr)r1rrrrrRrr0rrqr*rrrr))r:rs r;rzDocket.schedules8  ) ) ++-++-%i&=&=*  4++I6=++MM ""++-#224'/ 4 44$$U$3 3 35 48 AN$++-N93K3K3MNO 45 4 4s=AD:BD. D:D.(D,)D.-?D:,D..D73D:cKtjdi|jd|i5|j4d{}|j ||d{dddd{|j |j ||d{dddtjd|jy77l7^#1d{7swYnxYw7L#1swYKxYww)aCancel a previously scheduled task on the Docket. If the task is scheduled (in the queue or stream), it will be removed. If the task is currently running, a cancellation signal will be sent to the worker, which will attempt to cancel the asyncio task. This is best-effort: if the task completes before the signal is processed, the cancellation will have no effect. Args: key: The key of the task to cancel. z docket.cancelz docket.keyrNr) r1rrr_cancelrcancel_channelr'r)r:rqrs r;cancelz Docket.cancels ) ) ;$++-;s;*  ?zz| / /ull5#... / /-- 3 3C 8#> > > ? At{{}-  /. / / / / ? ? ?s,C1C%CC%CC C" C%-C .(C%C#C%-C1C% C C%C CC C%%C.*C1c Kddl}|j4d{}|j|j|d{}|s dddd{y|j d}|j d}|j d}|r|r|s dddd{y|j }|j j |} | s d d} || _| } |j|} |j|} |j d} | s dddd{ytjt| j tj}dd lm}||| | | ||d }|j!d{|cdddd{S77d7T7 77%7#1d{7swYyxYww) aGet a task Execution from the Docket by its key. Args: key: The task key. Returns: The Execution if found, None if the key doesn't exist. Example: # Claim check pattern: schedule a task, save the key, # then retrieve the execution later to check status or get results execution = await docket.add(my_task, key="important-task")(args) task_key = execution.key # Later, retrieve the execution by key execution = await docket.get_execution(task_key) if execution: await execution.get_result() rNsfunctionsargsskwargsc Kywr8r9r9rCr; placeholderz)Docket.get_execution..placeholder@s r=swhen)tz)r$r)rWrr5rrqrrr6N) cloudpicklerhgetallruns_keygetdecoderQr>loadsr fromtimestampfloatrrdocket.executionr$sync)r:rqrrdatar args_data kwargs_datafunction_name_strrrr5rwhen_strrr$rs r; get_executionzDocket.get_executions( ::<4 4 5&t}}S'9::D 4 4 4 !HH[1M)I((9-K 4 4 4 !. 4 4 6 zz~~&78H(9 $&$$Y/D &&{3Fxx(HC4 4 4 D))%0A*Bx||TD 3!!I.." " "i4 4 4 :4 4 4 d #e4 4 4 4 sG F%G %F7F(F7 G F+G :F7 G "F.#G (A0F7 G #F1$G )A$F7 F3F7 G F5 G (F7+G .G 1G 3F75G 7G =G >G G c$|jdS)Nqueuerqrjs r; queue_keyzDocket.queue_keybsxx  rCc$|jdS)Nstreamrrjs r; stream_keyzDocket.stream_keyfsxx!!rCtask_keyc*|jd|S)Nzknown:rr:rs r;known_task_keyzDocket.known_task_keyjsxx& +,,rCc$|j|Sr8rrs r;parked_task_keyzDocket.parked_task_keymsxx!!rCc*|jd|S)Nz stream-id:rrs r; stream_id_keyzDocket.stream_id_keypsxx*XJ/00rCc*|jd|S)z>@AK%,,}k: : :%,,}- - -%  ; .s7CE EA E "E#E =E>E E E  parameteroperatorvaluecNKt|r |jn|}t||t||}tj di|j |j 5|jj|d{dddy7 #1swYyxYww)a7Strike a task from the Docket. Args: function: The task to strike (function or name), or None for all tasks. parameter: The parameter to strike on, or None for entire task. operator: The comparison operator to use. value: The value to strike on. z docket.strikerN) callabler>r.r,r1rrrRsend_instructionr:rrrr r instructions r;strikez Docket.strikes.6h-?))X ]Ix7I5Q  ) ) @$++-@;+=+=+?@*  A""33K@ @ @  A A A  A A0A(B%*B B B B%BB"B%cNKt|r |jn|}t||t||}tj di|j |j 5|jj|d{dddy7 #1swYyxYww)aMRestore a previously stricken task to the Docket. Args: function: The task to restore (function or name), or None for all tasks. parameter: The parameter to restore on, or None for entire task. operator: The comparison operator to use. value: The value to restore on. zdocket.restorerN) r r>r-r,r1rrrRr r s r;restorezDocket.restores.6h-?))X mY8JER  ) ) @$++-@;+=+=+?@*  A""33K@ @ @  A A A  A ArcTK|jjd{y7w)aWWait for all existing strikes to be loaded from the stream. This method blocks until the strike monitor has completed its initial non-blocking read of all existing strike messages. Call this before making decisions that depend on the current strike state, such as scheduling automatic perpetual tasks. N)rRwait_for_strikes_loadedrjs r;rzDocket.wait_for_strikes_loadeds 66888s (&(c DKtjd|j5|j4d{}|j4d{}|j |j |j|j|j|jdd|jd{\}}}dddd{g}dkDrW|j|j ddd{}|D],\}} d| vs |j| dj.|j4d{}|dkDr|j|j dd |j|jD]} | j} |j|j!| |j|j#| |j|j%| |j'| } |j(r6t+|j(j-} |j/| | |j| |D]f} |j'| } |j(r6t+|j(j-} |j/| | V|j| h|jd{|z}|cdddd{cdddd{cdddS777e7T#1d{7swYexYw7@77^7I7:#1d{7swYnxYwdddd{7n#1d{7swYnxYwdddy#1swYyxYww) aAClear all queued and scheduled tasks from the docket. This removes all tasks from the stream (immediate tasks) and queue (scheduled tasks), along with their associated parked data. Running tasks are not affected. Returns: The total number of tasks that were cleared. z docket.clearrNr-+skeyF)maxlen approximate)r1rrrpipelinexlenrzcardrzrangeexecutexrangeappendrxtrimrrrrrrarNrr)r:rr stream_count queue_countscheduled_keys stream_keysmessagesrHfields key_bytesrrr total_cleareds r;clearz Docket.clearsB ) ) {{}* < )zz|8 )8 )u)5>>+ Y YxMM$//2NN4>>2OODNNAr: GOFVFVFX@X=L+~ Y Y*, !#%1U\\$//3%LLH.6H* F!V+'..vf~/D/D/FGH *5>>+")")x$a' tqeTOODNN3&4 ; #,#3#3#5 (<(M(E")")")-8 )8 )8 ) < )< )8 ) YAY Y Y Y Y M ")>-?")-8 ),")")")-8 )8 )8 )8 )8 ) < )< )< )sB&N NL!NM6L$ M6A'L-L' L- M6L*,M6MM69M6M M6FM*M + M5 M6M M6 NM N N !N$M6'L-*M6-M 3L64M ; M6M6 M M6 NM! MM! M6$ N/M20N6N <M?=N N N NN r8)NNr)NNz==N)Fr>r?r@__doc__dictrBr%rMr/r!r"r3rrrNrboolrhpropertyrkrmrqrrwtype BaseExceptionrrrr rrrrrrrArrrrrr rDr rErr$rrrrrrrrrrrrrzrrr,r+r rrrr+r9rCr;rPrPVs+  \! "" "T))%,, -(1!(...0JsJy4/?JX!3!!"C""-s-s-"""1c1c1,,,.s.s.#C##&P.5<#7P.cP.dP.h<@ $/3!% A1il?+c1D8A:A_, A $ A  A4<@ $/3!% A1il?+c1D8A:A_, A $ A  A09F)SF)rCrP)Wrlogging contextlibrrrrrtypesrtypingr r r r r rrrrrrrrredis.exceptionsr!key_value.aio.protocols.key_valuer opentelemetryr redis.asynciorredis.asyncio.clientrredis.asyncio.clusterrtyping_extensionsr_docket_snapshotrrrr rSr! _result_storer"_uuid7r#rr$r%instrumentationr&r'r(r)r* strikelistr+r,r-r.r/ getLoggerr>r0LoggerrM get_tracerr1Tracerr3rDrETaskCollectionrL RedisStreamIDRedisMessageIDr- RedisMessagetuple RedisMessages RedisStreamRedisReadGroupResponserGrPr9rCr;rNs3:22 ;'.">1B6#(+**844'u''1 18 cN CL,' E5L! ~|;<= M=01 !+. O ) O )rC