TaskJudge

Solution Trace 수집·검증 · taskjudge.com
tj_20260823T201804_18bc1d2a-forgedUnverified Generic CLI Agent · poc/negative-tests · 제출자 익명
서버 판정
unverified
grade-policy-2026-08-23
클라이언트 주장
certified
서명 검증
실패
서명 불일치 (manifest 변조 의심)
체인 연결
정합
이벤트 14건
토큰 (in / out / cache)
0 / 0 / 0
· source=
비용
미산출 ()
가격표
실행 시간
0.30s
exit=0
CPU / 최대 메모리
0ms / 3MB
프로세스 2개
capability
cost_usageunavailable
file_traceos
tool_traceos
token_usagenative
prompt_tracepartial
network_traceos
등급 판정 항목
file_trace충족
tool_trace미충족
chain_sealed미충족
prompt_trace미충족
usage_verified미충족
runner_boundary충족
runner_identity미충족
process_evidence충족
no_unexplained_gap충족
workspace_evidence충족
capability downgrade
token_usageAgent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
cost_usagetoken_usage 부재로 비용 산출 불가
암호학적 기록
trace_root_hashsha256:75ddd4a8dc38eab547ae6aae7f48616b62a358837baf39db261a8b471a941c1e
artifact_root_hashsha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
manifest_digestsha256:f3cfff7ceacc6a605945ae538a06d8ecd1d8f0db3824e2a6b656de2e85596501
runner public key-----BEGIN PUBLIC KEY----- MCowBQYDK2VwAyEAXr2INUktoFQ+wuP9rTwJkPZSWv9Cj2zTBwJOQTEYon0= -----END PUBLIC KEY-----…
관측 정밀도와 알려진 공백
process 50ms · network 200ms · filesystem 2000ms
타임라인 (원문 미포함)
원본
서버가 받은 제출 payload 전부. 여기 없는 것은 서버에 없다.
manifest
argv: 1 개
./agent.sh
task: poc/negative-tests
agent: generic
usage: {}
checks: 10 항목
file_trace: true
tool_trace: false
chain_sealed: true
prompt_trace: false
usage_verified: false
runner_boundary: true
runner_identity: false
process_evidence: true
no_unexplained_gap: true
workspace_evidence: true
runner: taskjudge-poc/0.1.0
network: 2 항목
hosts: []
endpoint_count: 0
wall_ms: 305
exit_code: 0
resources: 10 항목
cpu_ms: 0
source: wait4/rusage
cpu_sys_ms: 3
max_rss_kb: 3072
cpu_user_ms: 0
io_read_bytes: 0
process_count: 2
io_write_bytes: 4096
voluntary_ctx_switches: 4
involuntary_ctx_switches: 4
sealed_at: 2026-08-23T11:18:04.706Z
signature: 3 항목
alg: ed25519
sig_b64: vd5ZtEbVdx9hRL44WNmyXpSQSu4YSVIOONA+HlkPmjUYHRO9+g3gKREGqEDEXhfq3HfwXNUfR5bHd3AMf8BsCg==
public_key_pem: -----BEGIN PUBLIC KEY----- MCowBQYDK2VwAyEAXr2INUktoFQ+wuP9rTwJkPZSWv9Cj2zTBwJOQTEYon0= -----END PUBLIC KEY-----
workspace: /data/ais/bot/catcheri/workspace/taskjudge/poc/verify-workspace
collection: 7 항목
pty: true
network: os
process: true
filesystem: true
local_gateway: false
tls_intercept: false
native_telemetry: false
downgrades: 2 개
reason: Agent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
capability: token_usage
reason: token_usage 부재로 비용 산출 불가
capability: cost_usage
session_id: tj_20260823T201804_18bc1d2a-forged
started_at: 2026-08-23T11:18:04.706Z
event_count: 14
trust_grade: certified
capabilities: 6 항목
cost_usage: unavailable
file_trace: os
tool_trace: os
token_usage: native
prompt_trace: partial
network_trace: os
event_counts: 11 항목
agent_exit: 1
file_change: 1
process_exit: 2
agent_started: 1
process_start: 2
session_start: 1
pty_agent_output: 1
resource_summary: 1
workspace_snapshot: 1
workspace_final_diff: 1
capability_negotiated: 1
runner_build: 6 항목
python: 3.13.2
source: source-tree
package: taskjudge
version: 0.2.0
platform: Linux-6.8.0-138-generic-x86_64-with-glibc2.39
module_digest: sha256:3fdcbf71bf6c6fe8642d8c59cf8c3d0e74493441bea5fccbaac01fee81c8aed5
agent_display: Generic CLI Agent
failed_checks: 4 개
prompt_trace
tool_trace
usage_verified
runner_identity
trace_version: 1.0
policy_version: grade-policy-2026-08-23
redaction_hits: 2 항목
github: 1
openai: 1
stream_digests: 3 항목
files.jsonl: 3 항목
bytes: 425
lines: 2
digest: sha256:f19acd327eb69405dedad0b6fd6e16eafc64e6badfffff5cec4300244e31e7c0
usage.jsonl: 3 항목
bytes: 0
lines: 0
digest: sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
events.jsonl: 3 항목
bytes: 6913
lines: 14
digest: sha256:d590c89381e7b34ea0b65b8b19fcbce7ed76f003e5c4ecbbde365693771504df
trace_root_hash: sha256:75ddd4a8dc38eab547ae6aae7f48616b62a358837baf39db261a8b471a941c1e
artifact_root_hash: sha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
file_change_counts: 3 항목
created: 1
deleted: 0
modified: 0
capability_downgrades: 2 개
reason: Agent native telemetry 없음, Local Gateway 미사용 (taskjudge run --gateway 로 켤 수 있다)
capability: token_usage
reason: token_usage 부재로 비용 산출 불가
capability: cost_usage
observation_precision: 4 항목
known_gaps: 3 개
샘플링 주기보다 짧게 생존한 프로세스와 소켓은 누락될 수 있다
파일은 주기 스캔 + 시작/종료 스냅샷 diff 로 관측하므로 중간 변경 순서가 합쳐질 수 있다
TLS 를 종단하지 않으므로 요청 본문과 토큰은 네트워크 계층에서 관측 불가
network_sampling_ms: 200
process_sampling_ms: 50
filesystem_sampling_ms: 2000
서버 판정 (verdict)
checks: 10 항목
file_trace: true
tool_trace: false
chain_sealed: false
prompt_trace: false
usage_verified: false
runner_boundary: true
runner_identity: false
process_evidence: true
no_unexplained_gap: true
workspace_evidence: true
trust_grade: unverified
claimed_grade: certified
failed_checks: 5 개
chain_sealed
prompt_trace
tool_trace
usage_verified
runner_identity
chain_problems: []
policy_version: grade-policy-2026-08-23
grade_downgraded: true
runner_key_label: null
signature_reason: 서명 불일치 (manifest 변조 의심)
runner_fingerprint: 1fa4a86dafabffa806fdc6a3eb63bf0b920186dcf9710667450534ce371753aa
timeline (14건)
0.002s 세션 시작 seq 1
seq: 1
hash: sha256:0d5377cd1acace7316e080f88e117c72bf5fe68f1bcb3cdddf88b101872f687d
host: 4 항목
cwd: /data/ais/bot/catcheri/workspace/taskjudge
user: rootsall
python: 3.13.2
platform: linux
t_ms: 2
type: session_start
source: runner
0.002s capability 확정 seq 2
seq: 2
hash: sha256:d37f00e57505e800ac9dcd21cf603221c988db70f9143dba7ea375ac221d5a78
t_ms: 2
type: capability_negotiated
source: runner
0.004s workspace 스냅샷 seq 3
seq: 3
hash: sha256:1ed2f043f418104fab707b735bcf8ae6fe2a2f8a306689247cae90cf02f5f0da
t_ms: 4
type: workspace_snapshot
source: os
0.005s Agent 실행 seq 4
seq: 4
hash: sha256:c4f6a49fc9c7fadf63217e28625f94eac2be67d23936cce8df869b557ad424ab
t_ms: 5
type: agent_started
source: runner
0.060s 프로세스 시작 seq 5
seq: 5
comm: bash
hash: sha256:0fd7024bd844310f51d80a26204d77c9d4873930659182f68d44ccf841894ae1
t_ms: 60
type: process_start
source: os
0.060s 프로세스 시작 seq 6
seq: 6
comm: sleep
hash: sha256:4c7bc3a16a64838ee692a29e6e9df558a7f0e425b271a90833a86f8f40352098
t_ms: 60
type: process_start
source: os
0.308s Agent 출력(PTY) seq 7
seq: 7
hash: sha256:c469e7fe2c32536cbc18a06ad116bf5cc38bde3592153b9100857c55d88dfd5e
t_ms: 308
type: pty_agent_output
chars: 132
source: pty
0.309s Agent 종료 seq 8
seq: 8
hash: sha256:182ee5cb1da1b7c996b9a3ec3421ecbf54e4233e15970f9f51463ddfa7ba4e56
t_ms: 309
type: agent_exit
source: runner
exit_code: 0
0.367s 프로세스 종료 seq 9
seq: 9
comm: sleep
hash: sha256:4208d30f5b5df4685658721bdfb548b10dd9acaec2466302cbdbebd6fdc594c8
t_ms: 367
type: process_exit
source: os
0.367s 프로세스 종료 seq 10
seq: 10
comm: bash
hash: sha256:988029981625a2156ed35e2b4de36c36b46bb43d42cbb950e97982ebe1141371
t_ms: 367
type: process_exit
source: os
0.609s 파일 변경 seq 11
seq: 11
hash: sha256:759407d8002b387b9843b0f3f9de5ce4bbeeea217b5fc0b8e572c26ae5664fc6
path: out.py
t_ms: 609
type: file_change
change: created
source: os
0.609s 최종 diff seq 12
seq: 12
hash: sha256:97502a0104b5b42bed697d8387ec22f9cc7155594e5e72aafb5a3058f3275c5e
t_ms: 609
type: workspace_final_diff
source: os
0.610s 자원 요약 seq 13
seq: 13
hash: sha256:b486f903fca87ce962c44243eb383b800eda3807ebd637951b53b88fec3bd6fb
t_ms: 610
type: resource_summary
source: os
0.610s Trace 봉인 seq 14
seq: 14
hash: sha256:75ddd4a8dc38eab547ae6aae7f48616b62a358837baf39db261a8b471a941c1e
t_ms: 610
type: session_sealed
source: runner
API credentials never leave this device. TaskJudge servers receive only sanitized usage metadata, approved solution content, and cryptographic trace records.