{"task": {"agent_timeout": 3000, "task": "codegen__jaegertracing__jaeger-6061", "verifier_timeout": 3000, "instruction": "This is a code generation task. You are expected to write working code that solves the described problem.\n<issue>\n      Hello,\nI'm seeing 2 problems and I'm not sure they are related.\njaeger is deployed using the production template at https://github.com/jaegertracing/jaeger-kubernetes\n\n## problem 1 : collector errors\n```\n~ \u276f\u276f\u276f kubej logs jaeger-collector-2191353639-87k5x\n{\"level\":\"error\",\"ts\":1505932275.2450123,\"caller\":\"metrics/table.go:54\",\"msg\":\"Failed to exec query\",\"query\":\"[query statement=\\\"\\\\n\\\\t\\\\tINSERT\\\\n\\\\t\\\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\\\n\\\\t\\\\t\\\\t\\\\t    start_time, duration, tags, logs, refs, process)\\\\n\\\\t\\\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\\\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \\u0019\\u000c\\u0019\\u000c\\u0000\\u0016\u0314\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]\",\"error\":\"String didn't validate.\",\"stacktrace\":\"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:54\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\"}\n{\"level\":\"error\",\"ts\":1505932275.248957,\"caller\":\"spanstore/writer.go:237\",\"msg\":\"Failed to insert span\",\"trace_id\":\"2a07d8276378df0f\",\"span_id\":1370522953428962601,\"error\":\"failed to Exec query '[query statement=\\\"\\\\n\\\\t\\\\tINSERT\\\\n\\\\t\\\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\\\n\\\\t\\\\t\\\\t\\\\t    start_time, duration, tags, logs, refs, process)\\\\n\\\\t\\\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\\\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \\u0019\\u000c\\u0019\\u000c\\u0000\\u0016\u0314\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]': String didn't validate.\",\"errorVerbose\":\"String didn't validate.\\nfailed to Exec query '[query statement=\\\"\\\\n\\\\t\\\\tINSERT\\\\n\\\\t\\\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\\\n\\\\t\\\\t\\\\t\\\\t    start_time, duration, tags, logs, refs, process)\\\\n\\\\t\\\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\\\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \\u0019\\u000c\\u0019\\u000c\\u0000\\u0016\u0314\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]'\\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:56\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\\nruntime.goexit\\n\\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086\",\"stacktrace\":\"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).logError\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:237\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:143\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\"}\n{\"level\":\"error\",\"ts\":1505932275.249009,\"caller\":\"app/span_processor.go:109\",\"msg\":\"Failed to save span\",\"error\":\"Failed to insert span: failed to Exec query '[query statement=\\\"\\\\n\\\\t\\\\tINSERT\\\\n\\\\t\\\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\\\n\\\\t\\\\t\\\\t\\\\t    start_time, duration, tags, logs, refs, process)\\\\n\\\\t\\\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\\\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \\u0019\\u000c\\u0019\\u000c\\u0000\\u0016\u0314\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]': String didn't validate.\",\"errorVerbose\":\"String didn't validate.\\nfailed to Exec query '[query statement=\\\"\\\\n\\\\t\\\\tINSERT\\\\n\\\\t\\\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\\\n\\\\t\\\\t\\\\t\\\\t    start_time, duration, tags, logs, refs, process)\\\\n\\\\t\\\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\\\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \\u0019\\u000c\\u0019\\u000c\\u0000\\u0016\u0314\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\ufffd\\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]'\\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:56\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\\nruntime.goexit\\n\\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086\\nFailed to insert span\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).logError\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:238\\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:143\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\\nruntime.goexit\\n\\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086\",\"stacktrace\":\"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:109\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\"}\n```\n\nnote that all messages were at the same time, about 6 days ago.\nnot sure if this provides more info, but fwiw:\n```\n~ \u276f\u276f\u276f kubej get po\nNAME                                READY     STATUS    RESTARTS   AGE\ncassandra-0                         1/1       Running   2          27d\ncassandra-1                         1/1       Running   2          27d\ncassandra-2                         1/1       Running   5          27d\njaeger-agent-1133288941-xlgp3       1/1       Running   18         8d\njaeger-collector-2191353639-87k5x   1/1       Running   2          27d\njaeger-query-241882977-19q89        1/1       Running   2          27d\n~ \u276f\u276f\u276f kubej logs jaeger-collector-2191353639-87k5x -p\n2017/08/30 07:04:43 gocql: unable to dial control conn 172.25.0.4: dial tcp 172.25.0.4:9042: getsockopt: connection refused\n{\"level\":\"fatal\",\"ts\":1504076683.164841,\"caller\":\"collector/main.go:67\",\"msg\":\"Unable to build span handlers\",\"error\":\"gocql: unable to create session: control: unable to connect to initial hosts: dial tcp 172.25.0.4:9042: getsockopt: connection refused\",\"stacktrace\":\"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\\n\\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\\ngithub.co", "memory": "8192m", "runnable": false, "difficulty": "hard", "language": "", "cpus": "", "instruction_truncated": true, "category": "code-generation", "compose": false, "has_solution": true, "oracle": null, "docker_image": "", "taskset": "devopsgym", "tags": ["code-generation", "devops-bench"]}, "runs": []}