{ j~dZddlmZddlZddlZddlZddlmZmZddl m Z m Z ddl m Z ddl mZddlmZmZdd lmZdd lmZd Zd Zd ZdZd0dZGddee ZeGddZedefZGddZ eGddZ!d1dZ"d2dZ# d3dZ$dd d4dZ%d5dZ&dddddd ed! d6d"Z'Gd#d$ee Z(eGd%d&Z)eGd'd(Z*dd dded) d7d*Z+d dded+ d8d,Z,d9d-Z-ddded. d:d/Z.y);uutils/completion_callback_fallback_cancel.py task-2553+9a — CALLBACK_FALLBACK_CANCEL_ON_SUCCESS (회장 결정). 목적: normal completion callback collector 가 result/report/collector-result marker 생성을 durable 하게 완료했을 때, dispatch 시점에 사전 등록된 fallback callback cron 을 자동 제거하여 뒤늦은 redundant 발화를 없앤다. 설계 원칙 (task-2553+9a §4, §9-R.1~§9-R.5): * callback orchestrator(utils/anu_delegation_completion_callback.py) **무수정**. 본 모듈은 완전 분리·독립 — orchestrator 를 import/호출하지 않는다(§9-R.4). * cron remove 는 §9-R.1 5조건 결합 검증 전부 충족 시에만 (오발 제거 0). * success gate 는 §9-R.2 durable evidence 기반 — caller boolean 단독 금지. * cron-remove 실행은 dependency-injected `remover` (§9-R.5). 실 subprocess 호출은 운영 collector 만, 본 task 구현/테스트는 fake/dry-run only. 분류(CancelClassification): CANCELLED fallback cron 제거 성공 → fallback_cancelled=true ALREADY_GONE 이미 삭제됨(또는 만료) — idempotent, 실패 아님 ALREADY_FIRED 이미 발화함 — 기존 DUPLICATE_CALLBACK_IGNORED 경로 유지 SKIPPED_NORMAL_FAILED durable evidence 부재/HOLD/failure/partial → fallback 보존 SKIPPED_UNTRUSTED §9-R.1 5조건 중 하나라도 불충족 → remove 미실행 REMOVE_FAILED_WARNING remove 시도 실패 → warning marker, collector success 유지 ) annotationsN) dataclassfield)datetimetimezone)Enum)Path)CallableOptional)ANU_CALLBACK_KEY)fallback_schedule_registrylL5:fallback)holdhold_for_chairfailfailedfailureerrorpartialcrashkilledtimeoutaborted cancelledcanceledrunningpendingunknown) okpasspassedsuccess succeededcomplete completeddonedefensive_hold_passcftjtjj dS)Nz%Y-%m-%dT%H:%M:%SZ)rnowrutcstrftime,utils/completion_callback_fallback_cancel.py_now_utcr/Ks! << % . ./C DDr-c$eZdZdZdZdZdZdZdZy)CancelClassification CANCELLED ALREADY_GONE ALREADY_FIREDSKIPPED_NORMAL_FAILEDSKIPPED_UNTRUSTEDREMOVE_FAILED_WARNINGN) __name__ __module__ __qualname__r2r3r4r5r6r7r,r-r.r1r1Os#I!L#M3+3r-r1c8eZdZUdZded<dZded<dZded<y) RemoverResultuNcron remover 호출 결과. status: removed|already_gone|already_fired|failed.strstatusdetailNOptional[dict]raw)r8r9r:__doc____annotations__r@rBr,r-r.r<r<XsX KFCCr-r<.cVeZdZdZej j ddZddddZy) RealCokacdirCronRemoverun실 `cokacdir --cron-remove` wrapper (운영 collector 전용 기본값). 본 task 의 regression 은 fake remover 를 주입하므로 이 클래스의 subprocess 경로는 테스트에서 절대 실행되지 않는다(§9-R.5). dry_run=True 면 subprocess 호출 자체를 하지 않고 시뮬레이션 결과만 돌려준다(이중 안전장치). COKACDIR_BINz/usr/local/bin/cokacdirTdry_runc \|rtddd|dStj|jd|dt t dt gddd } tj|jjxsd }|jddk(rtdd|St |jddj}d|vsd|vsd|vrtd||Std|xsd|S#tj$r d |jjd }YwxYw)NremoveduEdry-run: 실 subprocess 호출 0 (운영 collector 만 실제 제거)T)rIcron_idr>r@rBz --cron-removez--chatz--key<)capture_outputtextrz{}r)r>messager>rz cokacdir okrQr?z not foundzno suchalready already_goner remove failed)r< subprocessrunbinaryr= ANU_CHAT_IDANU_KEYjsonloadsstdoutstripJSONDecodeErrorgetlower)selfrLrIprocpayloadmsgs r.__call__z RealCokacdirCronRemover.__call__os.   ^ $9  ~~ K      Jjj!2!2!4!<=G ;;x D ( -WU U'++i,-335 # c!1Y#5E sP PHS5KOQXYY## J!(T[[5F5F5HIG Js1C880D+*D+N)rLr=rIboolreturnr<) r8r9r:rCosenvironr_rWrer,r-r.rFrFes'ZZ^^N,E FF8<Zr-rFceZdZUded<ded<ded<ded<ded<ded <ee Zd ed <ee Zd ed <dZded<ee Z ded<ee Z ded<dZ ded<ddZ y)CancelDecisionr1classificationr=task_idtarget_cron_idrfcron_remove_invokedfallback_cancelledcancel_skipped_reason)default_factorydictsafe_remove_checksdurable_evidenceNrAremover_resultlist hold_reasonsnotesr?ts_utcc&d|j|j|jj|j|j |j |j|j|j|j|j|jd S)N"callback_fallback_cancel_result_v1) schemarmrnrlrorprqrtrurvrxryrz) rmrnrlvaluerorprqrtrurvrxryrzras r.to_dictzCancelDecision.to_dicts{:||"11"1177#'#;#;"&"9"9%)%?%?"&"9"9 $ 5 5"11 --ZZkk  r-rgrs)r8r9r:rDrrsrtrurvrwrxryrzrr,r-r.rkrks|(( L$T::"48d8%)NN)t4L$4-E4-FC r-rkc tj|jdS#ttjf$rYywxYw)Nutf-8encoding)rZr[ read_textOSErrorr^)paths r. _read_jsonrs>zz$..'.:;; T)) *s$'AAc|xsdjjsytD]}|vsytfdtDS)Nr?Fc34K|]}|k(xs|vywNr,).0tokss r. z%_status_is_success..s!Fsax#3!8#Fs)r]r`_FAILURE_STATUS_TOKENSany_SUCCESS_STATUS_TOKENS)r>rrs @r._status_is_successrsQ 2$$&A % !8 F/EF FFr-c"dddddddd}t|}|du|d<|j|jdxs;|jdxs(|jdxs|jd xsd}||d <tt||d <|j xr|j j d kD|d <|j |d<|dsd|d<|S|d sd|d d|d<|S|d sd|d<|S|dsd|d<|Sd|d<d|d<|S)u§9-R.2: result.json(존재 AND status 성공/비-HOLD/비-failure) + report + collector-result marker 가 실재·정합할 때만 success. boolean 은 권위 아님.FNr?)result_json_existsresult_json_statusresult_json_status_ok report_existscollector_result_marker_exists satisfiedreasonrr>rl final_statusresultrrrrru8result.json 부재 → normal collector 미완료/실패ru,result.json status 비-성공/HOLD/failure ()u"report 부재 또는 비어 있음ucollector-result marker 부재Tru5durable evidence 정합 (result+status+report+marker))rr_rr=existsstatst_size)result_json_path report_pathcollector_result_marker_pathevrjr>s r.evaluate_durable_evidencers$"!&*/B $ %B!~B ~ FF8  vv&' vvn% vvh  $*  &8V&E "#?!1!1!3!;!;a!?,H+N+N+PB'( " #Q8  I' (:2>R;S:VVW X 8  I ;8 I 0 178  I;N8 Ir-)callback_contractc "ddddddddddd }t|}|d|d<|Sd|d <|jd }t|tsd |d<|S|jd }||d <t |xrt|t xr||k(|d<|jd|k(|d<|jdt k(xr|jdtk(|d<|jdtk(|d<t |xr|d|d<|.|jd }|d|d<n||k(rd|d<n d|d<d|d<t|d|d|d|d|df|d<|ds+dD cgc] } || s|  } } ddj| z|d<|Scc} w)u§9-R.1 5조건. dispatch-fired marker 의 callback_policy_a.fallback_callback_cron_id 가 단일 권위. callback contract 는 동일값 교차확인용 보조일 뿐 단독 권위 아님.FNzn/ar?) c1_marker_id_matchesc2_task_binding c3_ownershipc4_role_fallbackc5_not_stale_or_typo all_satisfiedmarker_presentauthority_cron_idcontract_cross_check fail_reasonuQdispatch-fired marker 부재/파싱불가 → 추정 remove 0 (SKIPPED_UNTRUSTED)rTrcallback_policy_auBmarker.callback_policy_a 부재 → fallback_cron_id 권위 없음fallback_callback_cron_idrrrmrchat_idanu_keyr fallback_rolerrcontract_no_fallback_idrmatchMISMATCHr)rrrrru5조건 미충족: ,) rr_ isinstancersrfr=rXrY FALLBACK_ROLEalljoin) rmrndispatch_fired_marker_pathrchecksmarkerpolicy authority_id contract_idkrs r.evaluate_safe_removersH!& ! %! % F2 3F ~ _ } #F  ZZ+ ,F fd # P } ::9:L".F &* + |S ) + N *&F !" !' 9 5 @F   9, - JJy !W , >  ?#}4 &*,%7&F=F !" $'++,GH  -FF) * L (-4F) *-7F) *-2F) *! ) * $ % > " % & ) *  F? / "  !9     !68H H} M  s#F c |jjddtjt |tj tj ztjzd}tj|dd5}|jtjttjdd d d y#t$rYywxYw#1swYyxYw) uO_CREAT|O_EXCL atomic — normal-success-cancel vs fallback-fire race 에서 단일 처리만 허용(이중 처리·재escalate 0).Tparentsexist_okiFwrr) locked_atpidN)parentmkdirrhopenr=O_CREATO_EXCLO_WRONLYFileExistsErrorfdopenwriterZdumpsr/getpid) lock_pathfdfhs r._acquire_cancel_lockr`std; WWS^RZZ"))%;bkk%I5 Q 2sW -L (*RYY[IJKL  L sA-CAC! CC!C*FT)fallback_cancelled_marker_pathcancel_lock_pathrnormal_collector_successremoverrInow_fnc t| t} | } t|||}t| |d<|ds)ttj ||ddd|d|dg|  St |||| }|d s]g}|d s|jd |d dk(r|jdttj||ddd|dd|||dg|  S|-t|s"ttj||ddd|||  S| || }|j|j|jd}|jdk(rv|O|jjdd|j!t#j$d||d| | ||dddd !ttj&||ddd"|||d#g| $ S|jd%k(r#ttj(||ddd&|||| ' S|jd(k(r#ttj||ddd)|||| ' Sttj*||ddd*|||d+g| $ S),unormal collector 성공 시 사전등록 fallback callback cron 자동 제거. `normal_collector_success` 는 보조 신호일 뿐 §9-R.2 durable-evidence gate 에 종속한다 — 단독으로 cancel 을 결정하지 않는다. )rrrcaller_boolean_auxrFuWnormal collector durable evidence 미충족 → fallback 보존 (예정대로 발화): rus§9-R.2: caller boolean 은 권위 아님 — durable evidence 부재 시 boolean=true 라도 SKIPPED_NORMAL_FAILED) rlrmrnrorprqruryrz)rmrnrrrru?dispatch-fired marker 부재 — fallback_cron_id 신뢰 불가rruBcallback contract vs marker 권위 id MISMATCH — 타 cron 위험u@§9-R.1 5조건 결합 검증 실패 → cron remove 미실행 (rruQ오발 제거 0: 신뢰할 수 없는 fallback_cron_id 는 절대 추정 remove 0) rlrmrnrorprqrtrurxryrzu동시 cancel 락 획득 실패 — 다른 처리기가 단일 처리 중 (이중 처리·재escalate 0, DUPLICATE 경로 유지)) rlrmrnrorprqrtrurzrHrMrKTrfallback_cancelled_v1)r}rmrrprIrzrtru) ensure_asciiindentrrr?z&fallback_cancelled=true marker persist) rlrmrnrorprqrtrurvryrzrSu@fallback cron 이미 삭제/만료 — idempotent, 실패 아님) rlrmrnrorprqrtrurvrz already_fireduJfallback 이미 발화 — 기존 DUPLICATE_CALLBACK_IGNORED 경로 유지ucron remove 실패 — warning marker. normal collector success 는 실패로 바꾸지 않음 (§3.5). fallback 은 DUPLICATE 경로로 음소거됨z2collector success preserved despite remove failure)rFrrfrkr1r5rappendr6rr4r>r@rBrr write_textrZrr2r3r7)rmrnrrrrrrrrrrIrtsrrrxrr remover_dicts r.cancel_fallback_on_successrps*)+ B #)%A B $$<=B k?/EE) %$**,X,9 <  &"%#=+ F / " &'   Q  ( )Z 7   T /AA) %$=)*!- &%c!  (#,@AQ,R/==) %$J &   1B ii299RVVLL yyI ) 5 * 1 1 7 7t 7 T * 5 5 "9#*5C.2#*"$.4,. "' ! 6 "/99) $#"$%';<   yyN"/<<) $$"d%'   yyO#/==) $$\%'  +AA%   `"#CD r-c$eZdZdZdZdZdZdZdZy) PruneCausecancel_not_wired cancel_failedschedule_not_found stale_round stale_head!normal_callback_already_collectedN) r8r9r:CANCEL_NOT_WIRED CANCEL_FAILEDSCHEDULE_NOT_FOUND STALE_ROUND STALE_HEAD!NORMAL_CALLBACK_ALREADY_COLLECTEDr,r-r.rr2s#)#M-KJ(K%r-rczeZdZUded<ded<ded<ded<ded<d ed <d ed <d ed <ded<ded<ddZy) PruneOutcomer=rmintroundhead_sharLr1rl Optional[str]causerfroprunedr@rzc |j|j|j|j|jj |j |j|j|j|jd S)N rmrrrLrlrrorr@rz) rmrrrLrlr~rrorr@rzrs r.rzPruneOutcome.to_dictKs\||ZZ ||"1177ZZ#'#;#;kkkkkk  r-Nrr8r9r:rDrr,r-r.rr>s< L JM L((  L K K  r-rc\eZdZUded<ded<ded<ded<ded <ded <ded <dd Zy )SelfCheckDecisionrfproceedrrr=r@rmrrrrzc|j|j|j|j|j|j |j dS)Nr rr@rmrrrzrrs r.rzSelfCheckDecision.to_dictgs=||ZZkk||ZZ kk  r-Nrr r,r-r.r r ]s+ M  K L JM K  r-r )rrIcanonical_root registry_pathrc | t}tj|||||} | sgSg} | D]~} || j|} |} | jdk(rpt j }d}d}d}| jxsd}tj| j| j| j| jd||||n| jdk(rt j}tjj}d}d}| jxsd}tj| j| j| j| jtjj|||n| jd k(rt j }tj"j}d}d}| jxsd }tj| j| j| j| jtj"j|||n>t j$}tj&j}d}d }| jxsd }| j)t+| j| j| j| j|||||| | S#t,$r}| j)t+| j| j| j| jt j$tj&jdd d t/|j0d|| Yd}~#d}~wwxYw)uregistry 기반 idempotent prune. recs가 비어있으면 [] 반환 (이미 prune됨/없음 — idempotent 재실행 안전). 각 rec에 대해 remover를 호출하고 PruneOutcome 리스트를 반환. NrrrHrKT pruned_on_)rmrrrLrrrrrSrFrTr zREMOVE_FAILED_WARNING: z: )rFr pending_forrLr>r1r2r@ mark_prunedrmrrr3rrr~r4rr7rrr Exceptiontyper8)rmrrtriggerrrIrrrrecsoutcomesrecrrrlrrorr@excs r.prune_fallbacks_for_keyrvs")+ % 1 1 %#  D  HZY g6BByyI%!5!?!?&*#/i*66KK)) \\KK&wi0#1"/! n,!5!B!B"55;;&*#4n*66KK)) \\KK$77==#1"/! o-!5!C!C"DDJJ&*#5o*66KK)) \\KK$FFLL#1"/! "6!K!K"0066&*#5o OOKK)) \\KK#1(;!!  {Zv O!  OOKK)) \\KK#7#M#M$2288(, 4T#Y5G5G4H3%P!8    sI:J33 M.,s'/0*Q***s$&c3:K|]}|jsdyw)N)rr's r.rz'summarize_live_prune../s7Qahhq7s)real_tombstone pruned_countcauses)rsumr)rr+r,r(r-s r.summarize_live_pruner/%s\4<N7(77L' (!agg (F (($ )sA) current_roundcurrent_head_shanormal_callback_collectedrc p|}|r*tdtjjd||||S|6||kr1tdtjjd|d|d||||S|r8|r6||k7r1tdtj jd|d |d ||||Std dd ||||S) u`fallback cron 실행 시점 2계층 방어 stale self-check. 우선순위: 1. normal_callback_collected True → NORMAL_CALLBACK_ALREADY_COLLECTED 2. current_round is not None and round < current_round → STALE_ROUND 3. current_head_sha and head_sha and head_sha != current_head_sha → STALE_HEAD 4. 그 외 → proceed=True Furnormal callback already collected — fallback must not fire (stale self-check: NORMAL_CALLBACK_ALREADY_COLLECTED)rNzfallback round z < current round u/ — stale fallback must not fire (STALE_ROUND)zfallback head_sha z != current head_sha u. — stale fallback must not fire (STALE_HEAD)Tz@recovery-only: no stale condition, fallback may fire as recovery)r rrr~rr)rmrrr0r1r2rrs r.fallback_self_checkr4;s$ B  >>DDH   U]%: ((..!%(9-IAA  H5E)E ''--$XL0E#&&TV   Q r-)rgr=)rr rgrA)r>r=rgrf)rr rr rr rgrs) rmr=rnr=rr rrArgrs)rr rgrf)rmr=rnr=rr rr rr rr rOptional[Path]rr5rrArrfrOptional[Remover]rIrfrCallable[[], str]rgrk)rmr=rrrr=rr=rr6rIrfrrrrrr7rgrw)rmr=rrrr=rrfrrrrrr7rgzOptional[PruneOutcome])rrwrgrs)rmr=rrrr=r0z Optional[int]r1rr2rfrr7rgr )/rC __future__rrZrhrU dataclassesrrrrenumrpathlibr typingr r utils.callback_envelope_schemar rYutilsr rXrrrr/r=r1r<RemoverrFrkrrrrrrrrr rr$r/r4r,r-r.r@sx0# ('%F,  $ E434   3 % &(Z(ZV     FG///#' /  /t)- _ __!% _ & _  _J 06:'+(,%*!% (| ||!% |  |  |#'|%3|%|&|#||| ||DLdL     <     <"&$(#' ({ { { {  {  {{"{!{ { {L $(#' (( ( ( (  ( " (!( ((\6$(&*&+ (F F F F ! F $ F $F FFr-