TaskJudge

Solution Trace 수집·검증 · taskjudge.com
tj_20260823T211434_10a571b5-forgedUnverified Generic CLI Agent · poc/negative-tests · 제출자 익명
서버 판정
unverified
grade-policy-2026-08-23
클라이언트 주장
certified
서명 검증
실패
서명 불일치 (manifest 변조 의심)
체인 연결
정합
이벤트 14건
토큰 (in / out / cache)
0 / 0 / 0
· source=
비용
미산출 ()
가격표
실행 시간
0.30s
exit=0
CPU / 최대 메모리
0ms / 4MB
프로세스 2개
capability
cost_usageunavailable
file_traceos
tool_traceos
token_usagenative
prompt_tracepartial
network_traceos
등급 판정 항목
file_trace충족
tool_trace미충족
chain_sealed미충족
prompt_trace미충족
usage_verified미충족
runner_boundary충족
runner_identity미충족
process_evidence충족
no_unexplained_gap충족
workspace_evidence충족
capability downgrade
token_usageAgent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
cost_usagetoken_usage 부재로 비용 산출 불가
암호학적 기록
trace_root_hashsha256:019d6aa462695f9e67d57baef3ca439e6b3c5471d4dff34305af26822d301719
artifact_root_hashsha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
manifest_digestsha256:e1c97701bac9bc6414d07ce46f88218d3bcb95af6b43f18787aa869fa4969a3d
runner public key-----BEGIN PUBLIC KEY----- MCowBQYDK2VwAyEAXr2INUktoFQ+wuP9rTwJkPZSWv9Cj2zTBwJOQTEYon0= -----END PUBLIC KEY-----…
관측 정밀도와 알려진 공백
process 50ms · network 200ms · filesystem 2000ms
타임라인 (원문 미포함)
원본
서버가 받은 제출 payload 전부. 여기 없는 것은 서버에 없다.
manifest
argv: 1 개
./agent.sh
task: poc/negative-tests
agent: generic
usage: {}
checks: 10 항목
file_trace: true
tool_trace: false
chain_sealed: true
prompt_trace: false
usage_verified: false
runner_boundary: true
runner_identity: false
process_evidence: true
no_unexplained_gap: true
workspace_evidence: true
runner: taskjudge/1.0.0
network: 2 항목
hosts: []
endpoint_count: 0
wall_ms: 304
exit_code: 0
resources: 10 항목
cpu_ms: 0
source: wait4/rusage
cpu_sys_ms: 2
max_rss_kb: 3584
cpu_user_ms: 1
io_read_bytes: 0
process_count: 2
io_write_bytes: 4096
voluntary_ctx_switches: 4
involuntary_ctx_switches: 0
sealed_at: 2026-08-23T12:14:34.663Z
signature: 3 항목
alg: ed25519
sig_b64: /pCqvUzH3HNY5wBmXOydBrzap6L5DzQb9KB0faGIGuBLymplNR8vFBhwl1GodS/8rrm5c/zSOXOy51j8P4QhDQ==
public_key_pem: -----BEGIN PUBLIC KEY----- MCowBQYDK2VwAyEAXr2INUktoFQ+wuP9rTwJkPZSWv9Cj2zTBwJOQTEYon0= -----END PUBLIC KEY-----
workspace: /data/ais/bot/catcheri/workspace/taskjudge/poc/verify-workspace
collection: 7 항목
pty: true
network: os
process: true
filesystem: true
local_gateway: false
tls_intercept: false
native_telemetry: false
downgrades: 2 개
reason: Agent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
capability: token_usage
reason: token_usage 부재로 비용 산출 불가
capability: cost_usage
session_id: tj_20260823T211434_10a571b5-forged
started_at: 2026-08-23T12:14:34.663Z
event_count: 14
trust_grade: certified
capabilities: 6 항목
cost_usage: unavailable
file_trace: os
tool_trace: os
token_usage: native
prompt_trace: partial
network_trace: os
event_counts: 11 항목
agent_exit: 1
file_change: 1
process_exit: 2
agent_started: 1
process_start: 2
session_start: 1
pty_agent_output: 1
resource_summary: 1
workspace_snapshot: 1
workspace_final_diff: 1
capability_negotiated: 1
runner_build: 6 항목
python: 3.13.2
source: source-tree
package: taskjudge
version: 1.0.0
platform: Linux-6.8.0-138-generic-x86_64-with-glibc2.39
module_digest: sha256:2a134956fdbbe8526ab77d8acf6650b873411eff10eabaddb1047b30b95bb23e
agent_display: Generic CLI Agent
failed_checks: 4 개
prompt_trace
tool_trace
usage_verified
runner_identity
trace_version: 1.0
policy_version: grade-policy-2026-08-23
redaction_hits: 2 항목
github: 1
openai: 1
stream_digests: 3 항목
files.jsonl: 3 항목
bytes: 425
lines: 2
digest: sha256:a4f879a7776ae845f7ea0078e6d77175bc1947c51422a08f953c1af805472418
usage.jsonl: 3 항목
bytes: 0
lines: 0
digest: sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
events.jsonl: 3 항목
bytes: 6909
lines: 14
digest: sha256:4661f6649bd3a45f92d83f072177753d79276d3e62f0a9d537e2ed6f63d88625
trace_root_hash: sha256:019d6aa462695f9e67d57baef3ca439e6b3c5471d4dff34305af26822d301719
artifact_root_hash: sha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
file_change_counts: 3 항목
created: 1
deleted: 0
modified: 0
capability_downgrades: 2 개
reason: Agent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
capability: token_usage
reason: token_usage 부재로 비용 산출 불가
capability: cost_usage
observation_precision: 4 항목
known_gaps: 3 개
샘플링 주기보다 짧게 생존한 프로세스와 소켓은 누락될 수 있다
파일은 주기 스캔 + 시작/종료 스냅샷 diff 로 관측하므로 중간 변경 순서가 합쳐질 수 있다
TLS 를 종단하지 않으므로 요청 본문과 토큰은 네트워크 계층에서 관측 불가
network_sampling_ms: 200
process_sampling_ms: 50
filesystem_sampling_ms: 2000
서버 판정 (verdict)
checks: 10 항목
file_trace: true
tool_trace: false
chain_sealed: false
prompt_trace: false
usage_verified: false
runner_boundary: true
runner_identity: false
process_evidence: true
no_unexplained_gap: true
workspace_evidence: true
trust_grade: unverified
claimed_grade: certified
failed_checks: 5 개
chain_sealed
prompt_trace
tool_trace
usage_verified
runner_identity
chain_problems: []
policy_version: grade-policy-2026-08-23
grade_downgraded: true
runner_key_label: null
signature_reason: 서명 불일치 (manifest 변조 의심)
runner_fingerprint: 1fa4a86dafabffa806fdc6a3eb63bf0b920186dcf9710667450534ce371753aa
timeline (14건)
0.002s 세션 시작 seq 1
seq: 1
hash: sha256:36662c17d934b44cca2c1f7db7a2fd465ca3932c59b1df88148b44f6bb7f68c9
host: 4 항목
cwd: /data/ais/bot/catcheri/workspace/taskjudge
user: rootsall
python: 3.13.2
platform: linux
t_ms: 2
type: session_start
source: runner
0.002s capability 확정 seq 2
seq: 2
hash: sha256:883f967d40cdd340e7a190add02fe2442a2aa1e4006cdb67449c9d918551ba17
t_ms: 2
type: capability_negotiated
source: runner
0.003s workspace 스냅샷 seq 3
seq: 3
hash: sha256:b5ed2190fb5c37abc1265ad74605d434d03c6cab47fbc94dfa2fa19f60e9a910
t_ms: 3
type: workspace_snapshot
source: os
0.004s Agent 실행 seq 4
seq: 4
hash: sha256:022aca9381daf41638553cd4b540001dc560f7770b24c7ac3ac673a0bed78e59
t_ms: 4
type: agent_started
source: runner
0.058s 프로세스 시작 seq 5
seq: 5
comm: bash
hash: sha256:53d7cd0275a352774113fa3acc60cfc3f548e8837fb457d79e0d0da9b6fdb112
t_ms: 58
type: process_start
source: os
0.058s 프로세스 시작 seq 6
seq: 6
comm: sleep
hash: sha256:e97d7fc990fb4274524be6cf77c927437b98590bb20f67ebea17e4e23dec7efd
t_ms: 58
type: process_start
source: os
0.307s Agent 출력(PTY) seq 7
seq: 7
hash: sha256:c2d39b30ab5a8cfafb3dd3dfa706b79b3b89c2c6218f6f5a248c669f03a80fa6
t_ms: 307
type: pty_agent_output
chars: 132
source: pty
0.308s Agent 종료 seq 8
seq: 8
hash: sha256:c42e3be2806bcdda6900100c65510c914c8f6b77a3c232778841cae93fac7b0c
t_ms: 308
type: agent_exit
source: runner
exit_code: 0
0.369s 프로세스 종료 seq 9
seq: 9
comm: bash
hash: sha256:95426b9e5ad234cde5cb52701aab19a21e36bd3bbd5ba82fb5ce666f2f721cf4
t_ms: 369
type: process_exit
source: os
0.369s 프로세스 종료 seq 10
seq: 10
comm: sleep
hash: sha256:f2d2c700676eeca27502dc2eca99a9a8b2c73007110009bb333b1bd512f72117
t_ms: 369
type: process_exit
source: os
0.608s 파일 변경 seq 11
seq: 11
hash: sha256:9eb212dceb4fe785ee06f6eb6446d273895f4f3b1da8a80b7c550b54322ae8de
path: out.py
t_ms: 608
type: file_change
change: created
source: os
0.608s 최종 diff seq 12
seq: 12
hash: sha256:d75ce6d0b5bfa13972e36639d43e975a1e6fb9e705ad5ccb1e9c54afb7a46f0b
t_ms: 608
type: workspace_final_diff
source: os
0.608s 자원 요약 seq 13
seq: 13
hash: sha256:df19b11357f289e0f6f9ec15a5d88b4401f8ff74cde78d62c5b535df571a05ab
t_ms: 608
type: resource_summary
source: os
0.609s Trace 봉인 seq 14
seq: 14
hash: sha256:019d6aa462695f9e67d57baef3ca439e6b3c5471d4dff34305af26822d301719
t_ms: 609
type: session_sealed
source: runner
API credentials never leave this device. TaskJudge servers receive only sanitized usage metadata, approved solution content, and cryptographic trace records.