Cloudflare Developers•2y ago

Logpush no longer pushing logs to HTTP destination

I've got a logpush job that pushes to another worker. I've tried with and without a filter on the scriptname (so this worker doesn't recursively push logs). This worker simply pushes logs to axiom because of the test request when making the logpush job. this was previously working, but logs have stopped shipping entirely. I've tried creating it with and without filters and I still get the test event to check if the endpoint works (which is another broken request on it's own), but there are no logs shipping to this endpoint. I've waited over 1 hour after sending test logs to another worker and they are not shipping.

3 Replies

DanTheGoodmanOP•2y ago

curl -X POST "https://api.cloudflare.com/client/v4/accounts/$ACCOUNTID/logpush/jobs" \
-H "X-Auth-Key: $APIKEY" \
-H "X-Auth-Email: $EMAIL" \
-H "Content-Type: application/json" \
-d "{
  \"name\": \"workers-logpush\",
  \"output_options\": {
    \"field_names\": [\"ClientIP\", \"EdgeStartTimestamp\", \"RayID\", \"Event\", \"EventTimestampMs\", \"Outcome\", \"Exceptions\", \"Logs\", \"ScriptName\"],
    \"sample_rate\": 1.0,
    \"timestamp_format\": \"unixnano\",
    \"output_type\": \"ndjson\",
    \"batch_prefix\": \"[\",
    \"batch_suffix\": \"]\",
    \"record_prefix\": \"{\",
    \"record_suffix\": \"}\",
    \"record_delimiter\": \",\"
  },
  \"filter\": \"{\\\"where\\\":{\\\"key\\\":\\\"ScriptName\\\",\\\"operator\\\":\\\"\!eq\\\",\\\"value\\\":\\\"cloudflareaxioslogpush\\\"}}\",
  \"destination_conf\": \"https://$SUBDOMAIN.workers.dev/log?header_Authorization=Bearer%20$TOKEN&header_content-type=application%2Fjson\",
  \"dataset\": \"workers_trace_events\",
  \"enabled\": true
}"

curl -X POST "https://api.cloudflare.com/client/v4/accounts/$ACCOUNTID/logpush/jobs" \
-H "X-Auth-Key: $APIKEY" \
-H "X-Auth-Email: $EMAIL" \
-H "Content-Type: application/json" \
-d "{
  \"name\": \"workers-logpush\",
  \"output_options\": {
    \"field_names\": [\"ClientIP\", \"EdgeStartTimestamp\", \"RayID\", \"Event\", \"EventTimestampMs\", \"Outcome\", \"Exceptions\", \"Logs\", \"ScriptName\"],
    \"sample_rate\": 1.0,
    \"timestamp_format\": \"unixnano\",
    \"output_type\": \"ndjson\",
    \"batch_prefix\": \"[\",
    \"batch_suffix\": \"]\",
    \"record_prefix\": \"{\",
    \"record_suffix\": \"}\",
    \"record_delimiter\": \",\"
  },
  \"filter\": \"{\\\"where\\\":{\\\"key\\\":\\\"ScriptName\\\",\\\"operator\\\":\\\"\!eq\\\",\\\"value\\\":\\\"cloudflareaxioslogpush\\\"}}\",
  \"destination_conf\": \"https://$SUBDOMAIN.workers.dev/log?header_Authorization=Bearer%20$TOKEN&header_content-type=application%2Fjson\",
  \"dataset\": \"workers_trace_events\",
  \"enabled\": true
}"

for reference if it matters

DanTheGoodmanOP•2y ago

DanTheGoodmanOP•2y ago

sampling is turned off so I should be getting 100% of the logs

Gaming

Programming

Logpush no longer pushing logs to HTTP destination