[Node]: Support otel auto instrumentation when code is bundled

[timfish]

Problem Statement

OpenTelemetry auto instrumentation relies on import-in-the-middle and require-in-the-middle to hook loading of modules so they can be proxied and automatically instrumented. If the code is bundled, modules are not loaded so there is no auto instrumentation.

Solution Brainstorm

Using the Sentry bundler plugins, we can wrap the "loading" of modules and call the existing callbacks that hook up the instrumentation.

[AbhiPrasad]

https://docs.datadoghq.com/tracing/trace_collection/automatic_instrumentation/dd_libraries/nodejs/#bundling

[timfish]

https://github.com/open-telemetry/opentelemetry-js/issues/4174 https://github.com/DataDog/dd-trace-js/blob/master/packages/datadog-esbuild/index.js

[lforst]

open-telemetry/opentelemetry-js#4174 DataDog/dd-trace-js@master/packages/datadog-esbuild/index.js

I can imagine so many scenarios where this esbuild plugin will break.

[drewcorlin1]

For vis: I have this PR to add an esbuild plugin for this to OTel js contrib https://github.com/open-telemetry/opentelemetry-js-contrib/pull/1856

[lforst]

@drewcorlin1 huh neat. Thanks for sharing. We'll definitely investigate also creating a plugin ourselves.

[Michsior14]

Hey guys! Is there any ETA for providing the plugin for webpack/esbuild? This is still blocking us from migrating to v8 :/

[mydea]

Hey, sadly not so far! I think for now using a plugin such as mentioned/proposed by @drewcorlin1 is the way to go!

[Michsior14]

Hey, sadly not so far! I think for now using a plugin such as mentioned/proposed by @drewcorlin1 is the way to go!

Unfortunately it's only for esbuild, while I need to support webpack as well.

[mydea]

It's in our backlog and I'll make sure we make it part of our planning!

[Michsior14]

@mydea Any news?

[lforst]

@Michsior14 you'll see it here! We haven't started working on anything.

[enko]

Would it be possible to manually instrument the packages when using esbuild?

[chargome]

Hey @enko! You could go down the route of implementing something like https://github.com/open-telemetry/opentelemetry-js-contrib/pull/1856 yourself – but we haven't looked into creating a plugin like this ourselves.

[drewcorlin1]

@enko Give opentelemetry-esbuild-plugin-node a try! I'm currently working on plugins for other bundlers too (just wrapped up webpack + about to publish it, rollup is next). I'd love any feedback on it or if other bundlers would be helpful