Skip to content

After SIGHUP, events sent from existing connections are not processed by the collector #44433

@tokuhirom

Description

@tokuhirom

Component(s)

receiver/fluentforward

What happened?

Description

After receiving SIGHUP and restarting fluentforwardreceiver, events sent from already established connections are not processed by the collector. Existing connections continue sending events to the old eventCh, but since the collector is stopped, these events are lost.

Steps to Reproduce

  1. Start the receiver and establish a client connection.
  2. Send logs from the client and confirm they are processed.
  3. Send SIGHUP to restart the receiver (fluentReceiver.Shutdown() and then start a new one. fluentReceiver.Shutdown() will close the current eventCh).
  4. Continue sending events from the existing client connection.
  5. Observe that these events are not processed by the new collector.
Image

Expected Result

Events sent from existing connections after SIGHUP should be processed by the new collector.

Actual Result

Events sent from existing connections after SIGHUP are lost and not processed by the new collector.

Collector version

c2d9b0d

Environment information

Environment

OS: Alma linux 10
Compiler(if manually compiled): go 1.24.6

OpenTelemetry Collector configuration

receivers:
  fluentforward/tcp:
    endpoint: 127.0.0.1:8006
exporters:
  debug: {}
service:
  pipelines:
    logs/tcp:
      exporters:
        - debug
      receivers:
        - fluentforward/tcp

Log output

[root@otelcoltest opentelemetry-collector-contrib]# ./bin/otelcontribcol_linux_amd64 --config=otelcol-config.yaml
2025-11-20T23:41:59.601+0900    info    [email protected]/service.go:224 Starting otelcontribcol...      {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "Version": "0.140.1-dev", "NumCPU": 8}
2025-11-20T23:41:59.601+0900    info    extensions/extensions.go:40     Starting extensions...  {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:41:59.601+0900    info    [email protected]/service.go:247 Everything is ready. Begin running and processing data. {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:01.603+0900    info    Logs    {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "otelcol.component.id": "debug", "otelcol.component.kind": "exporter", "otelcol.signal": "logs", "resource logs": 1, "log records": 3}
2025-11-20T23:42:04.558+0900    info    Logs    {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "otelcol.component.id": "debug", "otelcol.component.kind": "exporter", "otelcol.signal": "logs", "resource logs": 1, "log records": 1}
2025-11-20T23:42:05.549+0900    info    Logs    {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "otelcol.component.id": "debug", "otelcol.component.kind": "exporter", "otelcol.signal": "logs", "resource logs": 1, "log records": 1}
2025-11-20T23:42:13.369+0900    info    [email protected]/collector.go:363       Received signal from OS {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "signal": "hangup"}
2025-11-20T23:42:13.369+0900    warn    [email protected]/collector.go:254       Config updated, restart service {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:13.369+0900    info    [email protected]/service.go:261 Starting shutdown...    {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:13.369+0900    info    extensions/extensions.go:68     Stopping extensions...  {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:13.369+0900    info    [email protected]/service.go:275 Shutdown complete.      {"resource": {"service.instance.id": "044da220-3d53-4747-88c0-6612e37c318a", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:13.372+0900    info    [email protected]/service.go:224 Starting otelcontribcol...      {"resource": {"service.instance.id": "9fa0fe5f-808a-4627-b127-f88d3e42d820", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}, "Version": "0.140.1-dev", "NumCPU": 8}
2025-11-20T23:42:13.372+0900    info    extensions/extensions.go:40     Starting extensions...  {"resource": {"service.instance.id": "9fa0fe5f-808a-4627-b127-f88d3e42d820", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}
2025-11-20T23:42:13.372+0900    info    [email protected]/service.go:247 Everything is ready. Begin running and processing data. {"resource": {"service.instance.id": "9fa0fe5f-808a-4627-b127-f88d3e42d820", "service.name": "otelcontribcol", "service.version": "0.140.1-dev"}}

Additional context

No response

Tip

React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions