Added local streaming support as suggested by @dmcgowan PTAL.
This currently works only for HTTP debug. For HTTP trace, we need to update the log package to be able to log to an arbitrary io.Writer.

/test pull-containerd-node-e2e

This currently works only for HTTP debug. For HTTP trace, we need to update the log package to be able to log to an arbitrary io.Writer.

What does the tracing need to use log.G(ctx) at all?

I wonder if we need the debug/trace options at all. If the a debug stream is provided, can we just add the traces or is the format of the debug stream already defined?

I still don't like the client being able to force the daemon into a debug mode and utilizing the daemon's logs. I think we could have separate trace (maybe debug, but probably better just for client) config on the daemon side that could add the trace data to the daemon logs.

For traces, the format of the output is up to us as we implement trace hooks.

If the a debug stream is provided, can we just add the traces

Ya, technically we can write in any format as long as we write it to the stream's io.Writer. I use logger here as it was used in the original implementation, but nothing prevents us from writing in raw format similar to debug transport.

/test pull-containerd-node-e2e

@mxpv Rebase?

Rebase?

@samuelkarp Done. But it now needs another LGTM

Reviews from dmcgowan and samuelkarp are stale because they were submitted before the most recent code changes.