Make use of >3 columns of a dataset

[derritter88]

Hi there, I have started working with your app as it is a real handy application - perfect for visualization. Unfortunately I am not able to add all csv columns to Analytics: I am monitoring my bandwith with speedtest-cli which puts the output into a csv file (see attachment, neede to change .csv to .txt as otherwise Github won't accept it) Speedtest_WAN.txt

When I open it with Analytics I just see "Date", "Time" & "Ping (ms)" - but no Down- & Upload. Is it possible to add more values into Analytics? Or maybe the column name is "wrong" so Analytics cannot read it?

Thanks, Mathias

[Rello]

Hello,

thank you for your request. In fact, that will be the main part of the next Analytics version: more flexible data structures.

currently everything depends (or is being normalized to) on a object/date/value combination. This made it easier for combining charts & tables in the first version

table is no issue, the biggest challenge will be a meaningful chart for your data. I did not check speedtest-cli but it if could output in a transponded format, it would be much easier to visualise

now you have a keyfigure model with every number in a column. to visualize it in a chart, an account model would be perfect. e.g.

type, date, value

download, 2020-01-01 , 1.2 ping , 2020-01-01 , 1.2

this would work now already and would also provide a nice select/deselect of a category in a chart

[derritter88]

Hello @Rello , unfortunately your suggestions does not work for me as I have type, date, time, value. I get those data written in an ongoing CSV file to monitor everything.

Your suggestion would work if I would create a separate CSV file for every single value.

If you have developed anything for this I would be happy to act as a tester for you.

[Rello]

Hey, what would be your need here? If I understood it correctly, you want to report on the file in realtime because it has all data. or does the file only have recent data and you want to load/persist the history in Analytics?

[derritter88]

Hi, both would work, I get an update on the file every hour - it would be a nice feature to have all data in Analytics and then apply a filter on it - e.g.:

1. See everything (Ping, Download, Upload, Date, Time)
2. Set a filter on Download for the last 7 days

[Rello]

ok, I am looking into it as it is a valid case. the result will be a kind of ETL where all source columns are extracted and the user needs to choose which to pick

In your case it will be 3 separate picks as you have the values in 3 columns. but as long as the setup is to be done once and then shown in one report, its easy

the only issue in your case will be the split date/time

lets see

[derritter88]

Might work if there would be a concat function?

[Rello]

For sure. Its just a matter of doing something that is generic and customizable

[Rello]

Hello, the first version to make it more flexible is to remove the column limit on the table completely. Until a more clever way is implemented, the chart always uses the last 3 columns of a dataset.

this does not help you (yet) completely, but is an important pre-step

[derritter88]

Great, thanks! Looking forward to the release of 2.1.0.

[Rello]

v2.1.0 releases. it does not solve the chart - but at least the full table is displayed already

[derritter88]

Good morning,

I have updated but I am no longer able to display any reports. For a few seconds the startpage of Data Analytics showed something like "Javascript ..." but just for a few microseconds.

Usually you are only able to see the startpage. If you click on any report nothing will happen.

[Rello]

Any log in the browser? Cache refreshed? ...working on Safari & Chrome here...

[derritter88]

I have deleted my Firefox cache, tried it a work with Firefox as well as Chrome - not working at all.

Freundliche Grüße

Mathias Mühlbacher

[Rello]

there needs to be some hint somewhere :-) are you familiar with the inspector/console in firefox? can you see i the report data is coming from the backend?

[derritter88]

I haven't thought about Firefox' console but maybe found something useful (hope you're familiar with german):

Die Ressource von "https://xxx.at/apps/files/" wurde wegen eines MIME-Typ-Konfliktes ("text/html") blockiert (X-Content-Type-Options: nosniff). analytics Laden fehlgeschlagen für das

[Rello]

thats strange. because thats an old file from the old highcharts, which had to be removed. something seems to be cached in your php server. the new version of DA does not request this file anymore

[derritter88]

that might be possible as I use caching on my server. I clear my cache later when I am back from work and see if the issue is being solved.

[derritter88]

It works now after I cleared the server cache

[mortee]

Did this topic totally die down in the last 2 years? I'd like to be able to analyze multi-dimensional data too (specifically, among others, Deck card numbers broken down by board, stack, assignee, tags, etc).

[Rello]

Hello @mortee when its about storing this data within Analytics internal tables - its still on the roadmap. the effort there is pretty significant.

when its about realtime data, more columns are possible. if its about deck integration, there is also a request here https://github.com/Rello/analytics/issues/295

[mortee]

I'd be more than OK with real-time external data, if that could be used for drilldown. But apparently that feature is disabled for reports based on those datasets.

Also it's not really clear how external data is treated, and the docs aren't exactly verbose about this either. When I have data with various label-type columns, one date and one number, I would expect it to be displayed as a separate series for each combination of the label-values, each plotted according to the date field.

However, when I create a report based on a CSV file, I get bars labeled by only the first filed, dates are not sequential on the x axis, but restart for each new value of the other labeling-type field(s). Maybe it can be tricked into doing what I expect, but it's not intuitive at all.

[mortee]

I'm quite sad this issue keeps being ignored. I still don't know how to analyze data with one date column, two (or more) dimension columns and one number column. It would be so nice to be able to see trends broken down by all the dimension columns, or aggregated by any combination thereof...

[Cyberseal89]

More to the above, also having issues understanding multi dimensional data, for example, a location in the X axis, timeline in the y axis, having a clustered bar for psi of 4 different gauges, and a line showing max threshold that the bars are below or above that range.

So here would be the columns:

1 - location - X axis 2 - date - Y axis 3 - gauge 1 - cluster bar 1 4 - gauge 2 - cluster bar 2 5 - gauge 3 - cluster bar 3 6 - max threshold - line for threshold

If this is possible, either through tables or excel, a tutorial would be wonderful.

V/R Casper

[Rello]

Hi, do you have a chart how you expect it to look like? from excel or so?

[mortee]

Maybe I'm still mistaken about how Analytics is supposed to work.

Ideally, I'd like to have this chart as a time series, and by default, have a separate line for each unique combination of dimension values (which in my case would mean direct display of my data, but in case I'd have multiple data points for the same date and dimension value combination, those would be summed up).

I'd like the ability to "turn off" the dimension fields independently, in which case there would be a separate line on the chart for each combination of values of the "turned on" dimensions, aggregated. When all the dimensions are turned off, there would remain a single chart line, with all data aggregated for each date value.

Also it would be nice to be able to filter based on dimension values, and show the lines only for the enabled values for a "turned on" dimension, or include in the aggregate for the "turned off" dimensions.