| teragrep exec syslog stream performance degrades after a few batches

[kortemik]

Describe the bug
| teragrep exec syslog stream performance degrades after a few batches

Expected behavior
performance would keep the same

How to reproduce
run a long running query that produces multiple batches

Screenshots

Software version

Desktop (please complete the following information if relevant):

• OS:
• Browser:
• Version:

Additional context
teragrep/dpf_02#13 may fix this

[eemhu]

Perhaps the dataset should not be returned to the UI at all as it is streamed elsewhere via syslog, bypassing batch collect entirely.

[kortemik]

It was intended to be returned so it could be further processed, however running | stats count after the query should help, right?

[eemhu]

It was intended to be returned so it could be further processed, however running | stats count after the query should help, right?

It could potentially help yes, if the root cause is the same as with the epoch migration command.
Let's see if dpf_02#13 helps with performance issues and go from there.

[kortemik]

dpf_02 change did not help. it introduced more bugs