3j݀ ~UdZddlmZddlZddlZddlZddlmZmZddl m Z ddl m Z m Z mZmZmZmZddlmZmZmZddlmZmZmZmZdd lmZdd lmZdd lm Z d Z!d Z"dZ#dZ$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,dZ-de.d<dZ/de.d<Gdde0Z1d6dZ2e$fd7d Z3d8d!Z4d9d"Z5d8d#Z6ed$%Gd&d'Z7dde$d( d:d)Z8eGd*d+Z9 d;d,Z:dddde;eeGd1d2Z?dd3 d>d4Z@gd5ZAy)?u)anu_v3.batch_settle_writeback — independent-ANU durable-success write-back + batch settle evaluator (task-2553+53 §3). 회장 §2 진단: +50/+51/+52 normal completion callback collector 가 모두 독립 ANU 로 AUTHORITATIVE_PASS 를 산출했으나, +44 durable 4-tuple registry (``memory/events/callback_4tuple_index.jsonl``) 에 durable-success(COMPLETED) 레코드가 0/3 → batch coordinator all-settled 자동 인식 실패 → last-settle collector consolidated summary 미생성. track 실패가 아니라 normal collector durable-success → registry write-back → batch settle trigger 결선이 미완. 이 모듈은 그 결선을 메운다: 1. 독립 ANU collector 의 terminal verdict(AUTHORITATIVE_PASS / PASS / ACCEPTED) 를 ``anu_v3.authoritative_verdict_selector`` 정본으로 *선택* (self-chain 영구 QUARANTINE — §3.3) 한 뒤, 2. ``anu_v3.self_collector_guard`` / ``anu_v3.writeback_binding_conflict_ guard`` 를 fail-closed 로 경유해, 3. §3.2 11종 필드를 담은 durable-success(COMPLETED) write-back 레코드를 +44 ledger 에 **additive append-only** 로 기록하고, 4. batch_id 기준 all-tracks-settled 를 normal-callback durable-success event 기준으로 즉시 평가한다 (고정시각/dead-man/fallback 진행 트리거 금지 — §3.6/§3.7). reuse, not re-implement: * +44 ``anu_v3.callback_4tuple_registry`` (append-only ledger, byte-0 — additive append 만, allowlist). * +49 ``anu_v3.authoritative_verdict_selector`` (self-chain vs independent ANU 권위 선택 정본). * +49 ``anu_v3.self_collector_guard`` (executor self-collector fail-closed). * +49 ``anu_v3.writeback_binding_conflict_guard`` (WRITEBACK_BINDING_ CONFLICT / idempotent skip). * ``dispatch.callback_owner_enforcer.DEFAULT_ANU_KEYS`` (ANU key 정본). Layer A / NO-CRON: 순수 분류 + append-only ledger WRITE (allowlist gated). ZERO cron register/remove, ZERO dispatch, ZERO subprocess, ZERO cokacdir, ZERO merge/PR/branch. fixed-time/dead-man/fallback 을 진행 트리거로 사용 0. ) annotationsN) dataclassfield)Path)DictListOptionalSequenceTupleUnion)AUTHORITATIVE_PASS VerdictRecordselect_authoritative_verdict)Callback4TupleRegistry make_recordrecord_is_validvalidate_record)guard_self_collector_session)guard_writeback_binding)DEFAULT_ANU_KEYSz anu_v3.batch_settle_writeback.v1zdurable_success_writeback.v1zbatch_settle_result.v1z/home/jay/workspacez)memory/events/callback_4tuple_index.jsonl%normal_callback_durable_success_event)r PASSACCEPTEDDURABLE_SUCCESS_WRITTENWRITEBACK_IDEMPOTENT_SKIPWRITEBACK_BINDING_CONFLICTTRACK_MISMATCHSELF_CHAIN_NO_WRITEBACK) task_idtrack_id dispatch_idnormal_collector_cron_id collector_keycollector_roleauthoritative_verdictterminal_status completed_atsource_result_pathbatch_idzTuple[str, ...]WRITEBACK_FIELDS_11)rr r#r!r%BINDING_IDENTITY_FIELDSceZdZdZy)WritebackPathRefusedu>A write outside the §9 allowlist was attempted (fail-closed).N)__name__ __module__ __qualname____doc__4/home/jay/workspace/anu_v3/batch_settle_writeback.pyr-r-osHr3r-c t|}ttj}|tk7r2t|j|k7rt d|dtd|dyy)uThe ONLY durable WRITE target is the +44 ledger (additive append). The write target is keyed to the ledger *identity* (the canonical allowlisted relpath, OR a path whose basename is the durable ledger file name — the latter only so isolated regression ledgers never touch the real +44 ledger). Any other target (a differently named file) = §9 violation -> refuse (fail-closed, never silent).z"durable-success write-back target u/ is NOT the §9 allowlisted append-only ledger z (nor a u2-named isolated ledger) — refused (fail-closed).N)_relpathrDEFAULT_LEDGER_RELPATHnamer-) ledger_pathrel ledger_names r4_assert_ledger_allowlistedr<ss{ ; C-.33K $$k):)?)?*#08..D-GH!_%   *$r3c tt|jjt|S#tt f$rt|cYSwxYwN)strrresolve relative_to ValueErrorOSError)proots r4r6r6sI47??$00d<==  1v s9<AAc|xsdj}dD]*}||vs|j|ddj},|S)u7``task-2553+50 (TRACK 1 — ...)`` -> ``task-2553+50``.)  (r)stripsplit)rawtidseps r4_normalize_task_idrQsO 9"   C/ #:))C#A&,,.C/ Jr3cx|D]5}t|ts|js%|jcSy)NrG) isinstancer?rL)valsvs r4 _first_strrVs4  a !'')779  r3cp|r3t|xsdjdddjdSdS)uL``7943afbe12c12f7d (self-chain, 영구 비권위)`` -> ``7943afbe12c12f7d``.rGrJrKr)rVrM)rNs r4 _strip_keyrXs8BE:syb''Q/2 3 9 9 ;A >M2Mr3T)frozenceZdZUdZded<ded<ded<ded<ded<ded<ded <ded <ded <ded <ded <ded<ded<dZded<dZded<dZded<dZded<ddZ ddZ y)WritebackBindinguThe §3.2 11-field durable-success binding extracted from an independent-ANU verdict file (untrusted free-text claims are NOT used to grant authority — origin is recomputed by the +49 selector).r?rr r!dispatch_id_sourcer"normal_collector_cron_id_sourcer#r$r%r&r'r(r)rG executor_keychat_idN Optional[str]fallback_callback_cron_idFboolsession_is_executor_selfc dj|j|j|j|j|j |j g}tj|jdjS)N|utf-8) joinrr r!r#r%r)hashlibsha256encode hexdigest)selfrNs r4 writeback_idzWritebackBinding.writeback_idshhh    ""**    ~~cjj12<<>>r3cidtd|jd|jd|jd|jd|j d|j d|jd |jd |jd |jd |jd |jd|jd|jd|jd|j ||j#d}|S)Nschemarr r!r\r"r]r#r$r%r&r'r(r)r^r_ra)writeback_classificationrm) DURABLE_SUCCESS_WRITEBACK_SCHEMArr r!r\r"r]r#r$r%r&r'r(r)r^r_rarm)rlclassificationrecs r4 to_recordzWritebackBinding.to_recordsH" 6" t||"   "  4++ " !$"9"9 " '(E(E "  .44"  T//"  d11"  $T%?%?"  t33"  D--"  !$"9"9"  !" " D--#" $ t||%" & ()G)G'" ()7 --/+" . r3)returnr?)rrr?ruzDict[str, object]) r.r/r0r1__annotations__r^r_rarcrmrtr2r3r4r[r[sILM!!%((ML#GS/3}3%*d* ?r3r[)r r^canonical_rootc (t|}tj|jd}t t |j d|j d}t ||j d|j d}|sd}t |j d|j d } |j d xsi} |j d xsi} tt | j d |j d |j d } | sRt |j ddk(r5|j ddvr"ttttd} t | j d|j dxsd} tt || j d|j d}t | j d|j d| j d}t | j d| j d|j d|j d}|rd}nd|}d}t | j d|j d}|rd}nd| }d}t | j d|j dxsd}t |j d|j d | j d}t|j dxs$|j d!xs|j d"}td)id|d|d|d#|d|d$|d | d| d| d%d&d |d't||d(|d|d|d|d!|S)*u+Read an independent-ANU verdict JSON and extract the §3.2 binding. dispatch_id / normal_collector_cron_id, when not source-recorded, are *deterministically derived* with explicit ``*_source`` provenance — a transparent, idempotent derivation, never a silent fabrication (§3.8). rfencodingrtasktrackr UNKNOWN_TRACKr%verdictfour_tuple_recordbatch_coordinator_integrationr#collector_owner_keyr$ANUexecutor_self_collector)FNrGr^r_dispatch_cron_idr!source_recordedzderived:derived_from_task_idr"zANU-normal-callback:derived_from_collector_keyraNts_kstr'rc!executor_self_chain_authoritativer\r]r& COMPLETEDr(r)r2)rjsonloads read_textrQrVgetrXnextitersortedrrbr[r6) source_pathr)r r^rwrDdatartrkr~fourbcir#r$exec_keyr_dispdisp_srcnccncc_srcfbr' self_sessions r4extract_binding_from_sourcers [A ::akk7k3 4D 488I&(89G Xtxx0$((:2F GC  ()488I+>G 88' ( .BD ((2 3 9rC HH_ % HH* + HH_ % M  txx 01 2e ;23}D f-=&>!?DM !"DHH-=$>   HH^ $ HH^ $ H TXXi0#'')2DG  #$  #$   D  $'#)  +, +, C #$]O4.  ,- ,-     DHH^4dhhx6HL *+ 9 88. / 9 887 8L     $   "%   )0  $ & & $ " $A~6     #%! "".# r3ceZdZUded<ded<ded<ded<ded<ded<ded <d ed <ee Zd ed<eddZddZ y)WritebackDecisionr?ror~rrrr r)Optional[Dict[str, object]]durable_recordrbappendeddefault_factory List[str]reasonsc |jdk(S)Nr)r~rls r4okzWritebackDecision.okns||v%%r3c |j|j|j|j|j|j |j |jt|jd S)N ror~rrrr r)rrr) ror~rrrr r)rrlistrrs r4to_jsonzWritebackDecision.to_jsonrsTkk||"11||  "11 DLL)  r3N)rurbrudict) r.r/r0rvrrrpropertyrrr2r3r4rrbsR K L LMM//Nt4GY4 &&  r3rcxg} |js|S|jd}|jD]U}|j }|s t j |}|jdtk(sE|j|W|S#t$r|cYSwxYw#t j$rYwxYw)zAll durable_success_writeback.v1 lines (fail-safe; corrupt lines skipped). +44 Callback4TupleRecord lines are ignored here.rfryro) is_filerrC splitlinesrLrrJSONDecodeErrorrrqappend)r9outtextrNds r4_ledger_durable_linesrs $&C""$J$$g$6 iik   3A 55?> > JJqM  J  ##   s(BBB# B B #B98B9)r r^expectedr9anu_keysrwc t|}|r t|n|tz } t||||| d* d+fd } |rtD cgc],} | |vr&t || t t | k7r| .} } | rfd| vsd| vrt nt} | d| d| d| d| Dcic]}||| c}d | Dcic]}|t |c}gj| Sjtvr$| dtd jd td gSttd djjj j"j$dj gj|}|j&t(k7s|j*dkr@| dtd|j&d|j*dgt-|j.zSt1jj j"j$}|j2s+| dtddj5|j.zgSj7}t9| D]Aj;d|k(r-t=fdtD}|r| dt>dgcSj;djk(sdj;dj@k(sj;djBk(sj;dj k(sj;djDk(sj;djk7s| dtd j;dd!jd"gjtcStG| }|jIj}tK|jjBjLxsd#jNd$jPj j|j$% }|j2s?| dtd&dj5|j.zgjtSjtR}tTD cgc]} |j;| r| }} |r| dtd'|d(g|S| dtRd)g|Scc} wcc}wcc}wcc} w),u§3.1/§3.2/§3.3/§3.8/§3.9 — evaluate (NO write) a durable-success write-back candidate from an independent-ANU verdict file. Pipeline (every step fail-closed, never a silent skip): 1. extract §3.2 binding from the source verdict file. 2. §3.9 mismatch — compare against ``expected`` (if given); any identity-field mismatch -> TRACK_MISMATCH / WRITEBACK_BINDING_ CONFLICT (RECORDED, never silent). 3. §3.3 — +49 ``select_authoritative_verdict``: self-chain origin is permanently QUARANTINED; only an independent-ANU terminal verdict is authoritative. self-chain -> SELF_CHAIN_NO_WRITEBACK. 4. §3 — ``guard_self_collector_session`` fail-closed (collector MUST be an independent ANU session). 5. §3.8 — idempotency over existing durable lines: identical binding -> WRITEBACK_IDEMPOTENT_SKIP; same idempotency identity but a different authoritative_verdict -> WRITEBACK_BINDING_CONFLICT. 6. §3.9 — ``guard_writeback_binding`` over the +44 ledger history. 7. clean -> DURABLE_SUCCESS_WRITTEN candidate (the §3.2 record). )r)r r^rwc ptt||jjj|d| S)NFr)r MODULE_SCHEMArr r))r~clsrrsbs r4 _decisionz5evaluate_durable_success_writeback.._decisions9! IIZZZZ  r3rr FAILzbinding identity mismatch on u — RECORDED as u-; silent skip is FORBIDDEN (§3.9). expected=z observed=zverdict z& is not a terminal write-back verdict u+ — no durable-success write-back (§3.1).collector_resultrindependent_anu) kindr~rr^r#r$rcclaimed_origindetail)rrrKu]authoritative_verdict_selector (+49 정본) did NOT classify this as AUTHORITATIVE_PASS (got z, independent_anu_count=u) — self-chain verdict is permanently non-authoritative; executor self-chain is NEVER written back as durable-success (§3.3).)r^r#r$is_executor_self_sessionzself-collector guard FAIL: ; rmc3~K|]4}tj|tt|k(6ywr>)r?rgetattr).0frlns r4 z5evaluate_durable_success_writeback..%s5BFF1I#gam"44s:=uidentical durable-success write-back already present (same writeback_id AND identical binding) — idempotent SKIP, NOT a duplicate append (§3.8).r!r#r)r%zDsame binding identity but a different authoritative_verdict (ledger=z vs candidate=uL) — RECORDED as WRITEBACK_BINDING_CONFLICT; silent skip FORBIDDEN (§3.9). 6937032012anu_collector_durable_success) rr!r_r"candidate_rolecandidate_fallback_cron_idcandidate_owner_keyr^r"candidate_session_is_executor_selfzwriteback binding guard FAIL: u1§3.2 mandatory write-back fields missing/empty: u: — refused (fail-closed, never a silent partial record).uindependent-ANU AUTHORITATIVE_PASS confirmed via +49 정본 selector; self-collector + writeback-binding guards PASS; §3.2 11-field durable-success record ready for additive append-only write-back.r>) r~r?rr?rrrsrrur)+rr7rr+r?rrrrtr%TERMINAL_WRITEBACK_VERDICTSrrrrr^r#r$rcrrr independent_anu_countrrrrrgrmrrallrr r!r)r history_forrr_r"rarr*)rr)r r^rr9rrwrElprr mismatchedrkselgwidsamereghistorywbrsmissingrrs @@r4"evaluate_durable_success_writebackrsV>  D)k t6L/LB#!  A7;  3  )  . H}Xa[!1SA5G!G    +zZ/G/  3J<@K1;? #>OO^^+,+E+E B 55 . - "**0E E F KK2 3   ++- .C-@QSWWQZq@G@ .CG9MLL      ' &   s =!G~As 1S,! S16S6)S;S;)rwct|}t||jtk(r|jj d|S|j r|jtk7r8|jj d|jd|jd|St|jxsi}|jjddtj|dd}t|d d 5}|j!|d z|j#t%j&|j)d d d |j+d}t-t/|dt/|dt/|dd|ddt/|j+dxsdt/|d|r t/|nd dd| t/|d }t1|sB|jj ddj3t5|zdzd|_|St9|j |d|_|jj d|S#1swY)xYw)u§3.1/§3.10 — durable-success additive append-only WRITE. ONLY the §9-allowlisted +44 ledger is writable (fail-closed). Two additive lines are appended: * the §3.2 ``durable_success_writeback.v1`` 11-field record, AND * a +44 ``callback_4tuple_ledger_record.v1`` COMPLETED line so the existing +44 ``classify`` / batch coordinator immediately observes ``NORMAL_CALLBACK_COMPLETED`` (this is the diagnosed §2 root-cause fix). No historical line is rewritten (append-only — +44 byte-0). IDEMPOTENT_SKIP / any FAIL classification -> NO write (idempotent / fail-closed). Returns the decision with ``appended`` set. u:idempotent skip — no duplicate append performed (§3.8).zclassification=z verdict=uq — NO durable-success write performed (fail-closed; mismatch/conflict/self-chain never silently written §3.9).T)parentsexist_okF) ensure_ascii sort_keysarfry Nrarr!zindependent ANU collector (key r#)r_rr"rrr') rr!rexecutorr_r"rarolestatus no_fallbackrz)WARN: +44-compat COMPLETED line invalid (rul) — durable_success_writeback line written; +44 mirror skipped (fail-closed, never an invalid +44 record).udurable-success write-back appended (additive, append-only): durable_success_writeback.v1 + +44 COMPLETED mirror line — batch coordinator now observes NORMAL_CALLBACK_COMPLETED (§2 root-cause fixed).)rr<rrrrrrrr~rrparentmkdirrdumpsopenwriteflushosfsyncfilenorrr?rrgrrr) decisionr9rwrrslinefhrc44s r4apply_durable_success_writebackrysJ( k Br"";; H  ;;(115LLh558 "#   x&&," -CIIOOD4O0 ::c >D b# (B     , -B C N#M*+S/0233G2HJCGGI&6,7!$S)C%D!E.03r7d ,V3~&' C 3  7ii,- .B B !2%%c*H   OOs :AI))I3ceZdZUded<ded<ded<ded<ded<ded <ded <ded <d ed <dZded<dZded<dZded<eeZ ded<ddZ y)BatchSettleResultr?ror)evaluated_at_basisrtracks_expectedtracks_settledrb all_settledall_authoritative_passrList[Dict[str, object]] track_statesF#this_collector_is_last_settle_trackTfallback_pending_non_blockingNr`#consolidated_summary_candidate_pathrrcn|j|j|jt|jt|j |j |j|j|j|jt|j|jt|jd S)N) ror)rrrrrrr r r r r)ror)rrrrrrrr r r r rrs r4rzBatchSettleResult.to_jsonskk "&"9"9#D$8$89"4#6#67++&*&A&A 8822 !2!2388DLL)'  r3r) r.r/r0rvr r r rrrrr2r3r4rrsj KM  M))05'5*.!4.9='=t4GY4 r3r) this_track_idcVt|}t|}i}|D]M}|jd|k7r|jdtk7r1||t |jd<Og}g} d} |D]\} } |j| } t | xr-| jddk(xr| jdt v}| r| jdnd}|r| j| |tk7rd } nd } |j| | | r| jdnd ||| r| jdndd t| tt|k(xr t |}|xr| }|rd nd }dtdt| dtt|dg}|r|jdn|jdt |xr||Dcgc]\}}| c}}vxr|}tt|t|Dcgc]\}}| c}}| |||||d| Scc}}wcc}}w)u§3.4/§3.5/§3.6/§3.7 — evaluate all-tracks-settled for ``batch_id``. ``expected_tracks`` = sequence of (track_id, task_id). A track is *settled* iff the +44 ledger has a ``durable_success_writeback.v1`` line for it with ``terminal_status == COMPLETED`` and a terminal authoritative verdict. The gate is judged ONLY on these normal-callback durable-success events — fixed-time / dead-man / fallback are NEVER a progress trigger (§3.7) and a fallback/dead-man pending state is explicitly NON-blocking (§3.6). decision = ``ALL_SETTLED_CONSOLIDATE`` iff every expected track is settled AND every verdict is AUTHORITATIVE_PASS (§3.5); else ``RECORD_AND_DEFER``. r)rpr Tr&rr%NFPENDING)r rr&r%durable_success_presentrpALL_SETTLED_CONSOLIDATERECORD_AND_DEFERzbatch settle judged on u ONLY — fixed-time / dead-man / fallback are NOT progress triggers (§3.7); a fallback/dead-man pending state does NOT block all-settled (§3.6)./z= tracks settled via durable_success_writeback.v1 (COMPLETED).uALL tracks settled AND every verdict is AUTHORITATIVE_PASS — last settle collector generates the consolidated summary candidate (§3.5).znot all-settled (or a non-AUTHORITATIVE_PASS verdict present) -> RECORD_AND_DEFER; the last settle track's independent ANU collector consolidates once 3/3 durable-success are recorded.) ror)rrrrrrr r r r)rrrrr?rbrrr lenrEVALUATED_AT_BASISrBATCH_SETTLE_RESULT_SCHEMA)r)expected_tracksr9rrdurableby_trackrr settledall_aprrrspresentr~r consolidaterrt_is_lasts r4evaluate_batch_settler"s* k B#B'G-/H - 55  (  55+ ,0G G +,QUU:&'( --/LG F' Wll3  +)*k9 +/0*+  7:#''12t  NN3 ,,F"25CGG-.9)0+2;>CGG67D   <g,#d?&;"<<BK(&K,7(=OH ""4!56N N w<.#d?34564 4 G !  L   Or3s%L# (??  EK=2 #A 5&D=I479!3 (_ ,I<I *&4N  $<<<F#"&.< y(yy y  y , yyz     ::#"&,059#F+;$<=.<](]] ]  ] * ]3]],]]H/= OO)O, O  Of $ $  $ X$( nn/n) n ! n  nb r3