Report not working

OpenSearch Dashboards Reporting Plugin
1

Hey,

I checked other entries but none matched my problem/version.
I have two systems, both using the opendistro docker images 1.13.2 for elasticsearch and kibana.
One i did a fresh install on, there the reports are working. But on the other system i updated from 1.1.0, there the reports are not working. I have some errors, but according to other posts from different sources (stackoverflow, …) these can be ignored.
These are e.g.:
{“type”:“log”,“@timestamp”:“2021-07-23T08:01:32Z”,“tags”:[“error”,“elasticsearch”,“data”],“pid”:1,“message”:“[version_conflict_engine_exception]: [search-telemetry:search-telemetry]: version conflict, required seqNo [8901], primary term [7]. current document has seqNo [8902] and primary term [7]”}
{“type”:“log”,“@timestamp”:“2021-07-23T08:04:31Z”,“tags”:[“error”,“elasticsearch”,“data”],“pid”:1,“message”:“[illegal_argument_exception]: request [/_license] contains unrecognized parameter: [accept_enterprise]”}

The report generation starts, but it never finishes. In the log i see after a long time that the report is finished, but I can never download it.
{“type”:“response”,“@timestamp”:“2021-07-23T08:01:46Z”,“tags”:,“pid”:1,“method”:“get”,“statusCode”:200,“req”:{“url”:“/api/reporting/generateReport/yLli0noBQIvN2Jb0KJ_z?timezone=Europe%2FZurich”,“method”:“get”,“headers”:{“host”:“10.180.226.198:5601”,“user-agent”:“Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0”,“accept”:“/”,“accept-language”:“en-US,en;q=0.5”,“accept-encoding”:“gzip, deflate, br”,“referer”:“https://10.180.226.198:5601/app/opendistro_kibana_reports",“content-type”:“application/json”,“kbn-version”:“7.10.2”,“connection”:“keep-alive”,“securitytenant”:“__user__”},“remoteAddress”:“10.180.224.15”,“userAgent”:"Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0”,“referer”:“https://10.180.226.198:5601/app/opendistro_kibana_reports"},“res”:{“statusCode”:200,“responseTime”:368025,“contentLength”:9},“message”:"GET /api/reporting/generateReport/yLli0noBQIvN2Jb0KJ_z?timezone=Europe%2FZurich 200 368025ms - 9.0B”}

I can open the dashboard I want to have the report about and it does not take very long to open.

I hope you have any hints on how to solve this problem.

BR,
Lukas

2

@reporting-team Thoughts on this one?

3

Bump

If anybody has ideas on this, please post them…

4

@v05
Hi, just want to clarity your issue first.
You said “after upgrade, there are reports not working.” The error log you posted can be ignored, you are right. I wonder if the “reports take too long to generate” is what you mean by “reports not working”?

1 Like
5

Hey @CyberGod,
Thank you for your reply!
When I want to create a report in the webinterface, I can’t download the report. In the log file I see that the generation of the report takes very long:
{“host”:“10.180.226.198:5601”,“user-agent”:“Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0”,“accept”:"/",“accept-language”:“en-US,en;q=0.5”,“accept-encoding”:“gzip, deflate, br”,“referer”:“https://10.180.226.198:5601/app/opendistro_kibana_reports",“content-type”:“application/json”,“kbn-version”:“7.10.2”,“connection”:“keep-alive”,“securitytenant”:"user”},“remoteAddress”:“10.180.224.15”,“userAgent”:“Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0”,“referer”:“https://10.180.226.198:5601/app/opendistro_kibana_reports"},“res”:{“statusCode”:200,“responseTime”:368025,“contentLength”:9},“message”:"GET /api/reporting/generateReport/yLli0noBQIvN2Jb0KJ_z?timezone=Europe%2FZurich 200 368025ms - 9.0B”}

I hope that makes it clear.

6

Got you. I saw the response time is 368025ms and contains 9.0 B data, which doesn’t make sense. I never seen this kind of issue before. But could your do the following things to help us debug?

  1. Does it fail for all types of reports? csv, png and pdf for all sources (Dashboards/visualize/Discover page)
  2. Can you go the reporting homepage and see if there’s a record being genereted in the table? Even tho you didn’t get it from browser, but since the 200 is returned, I think there will be a record being added to ES. If you download from the menu button on Dashboard page, it should be named as “on-demand report-xxx”. Please also try download the report again from there
1 Like
7

Holy moly. That’s a 2/3 of a byte a MINUTE.

8

Both pdf and png reports are not working.
An entry gets created in the Reports as well as in the Report definitions section on the reports page.
If I create a on demand report directly from the Dashboard page it also is not working. I see the “Generating report” popup, but it never finishes.

9

No hints on this one? I have the impression that the problem is the upgrade from a former version to the most recent. Can it be that the data in one of the opendistro indexes is wrong/did not migrate properly?

10

Hello

I’m trying to revive this thread, since there still is no solution in sight. We found the chromium headless command which gets executed by ELK and it goes as follows:

bash-4.2$ /usr/share/kibana/plugins/opendistroReportsKibana/server/routes/utils/../../../.chromium/headless_shell --disable-background-networking --enable-features=NetworkService,NetworkServiceInProcess --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-background-pages --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=TranslateUI,BlinkGenPropertyTrees --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-backgrounding --disable-sync --force-color-profile=srgb --metrics-recording-only --no-first-run --enable-automation --password-store=basic --use-mock-keychain --headless --hide-scrollbars --mute-audio --no-sandbox --disable-setuid-sandbox --disable-gpu --no-zygote --single-process --remote-debugging-port=0 https://10.163.239.71:5601/ --ignore-certificate-errors --log-level=100 --user-data-dir=/tmp/puppeteer_dev_profile-test
[1027/142251.047190:WARNING:resource_bundle.cc(358)] locale_file_path.empty() for locale

DevTools listening on ws://127.0.0.1:46732/devtools/browser/d1684072-6a1d-47c0-a841-4cb2795fc031
[1027/142251.358993:ERROR:cert_verify_proc_nss.cc(969)] CERT_PKIXVerifyCert for 10.163.239.71 failed err=-8179
[1027/142251.389260:INFO:CONSOLE(342)] "Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.", source: https://10.163.239.71:5601/app/login?nextUrl=%2F (342)
[1027/142251.442777:INFO:CONSOLE(43)] "^ A single error about an inline script not firing due to content security policy is expected!", source: https://10.163.239.71:5601/bootstrap.js (43)
[1027/142252.908660:INFO:CONSOLE(13)] "Error: Unauthorized", source: https://10.163.239.71:5601/36136/bundles/plugin/opendistroSecurityKibana/opendistroSecurityKibana.plugin.js (13)
[1027/142253.576084:INFO:CONSOLE(13)] "failed to get user tenant: Error: Unauthorized", source: https://10.163.239.71:5601/36136/bundles/plugin/opendistroSecurityKibana/opendistroSecurityKibana.plugin.js (13)

After that, it just hangs. Could the last INFO-Level message be a fatal error which doesn’t terminate the program?

11

This topic is still valid