Re: Bucketing,Slicing and Reporting data across multiple dimensions

Voronich:

I'd try making a 15000H x 550W bitmap (+ space for rulers on the borders) where the pixel values would show the variation: e.g., use red to represent positive and green for negative variation. That'll give you a quick feel for the data, and you can use the ruler to locate the dataset(s) of interest.

...roboticus

When your only tool is a hammer, all problems look like your thumb.

Comment on Re: Bucketing,Slicing and Reporting data across multiple dimensions

Replies are listed 'Best First'.
Re^2: Bucketing,Slicing and Reporting data across multiple dimensions by blue_cowdawg (Monsignor) on Aug 17, 2011 at 18:13 UTC
Talk about visual!! That's great!!! Peter L. Berghold -- Unix Professional Peter -at- Berghold -dot- Net; AOL IM redcowdawg Yahoo IM: blue_cowdawg	[reply]
Re^3: Bucketing,Slicing and Reporting data across multiple dimensions by pvaldes (Chaplain) on Aug 17, 2011 at 20:22 UTC
Still too abstract to me, but I think that when you say impact quantification you say: the last column number use GraphViz; open DATA, "<", "/my/data"; my $plot = GraphViz->new( layout => 'dot', # <--or neato, or circo etc node => {height => '0.05', shape => 'box',fontsize => '11', fontname = +> 'Times-Roman', style=>'filled', color=>'lightgray'}, bgcolor=> 'white', center=> 'true', dpi=> '1800', #resolution of the graph, higher = sloower ... more general parameters following here... ); while (<DATA>){ my ($idname, $fooname, $blah, $blah2, $impact) = split //,$_, 5 # spli +t ID in fields next if $impact = 0 # no impact between tests, so we discard this id-> +foo node $plot->add_node($idname, label => "$idname"); #create parent node $plot->add_edge($idname => $fooname, size => $impact) # trace an arrow + from to each id to its foo #i don't remember if size is valid, but instead you could use better +the tag color => $mycolor The goal with this is that you can create easily a customized %colorha +sh (when key = impact and value is a custom color... you can have mor +e, less hot, more blue, more red... for any impact range } # whe close while loop # and we print the plot to a svg file, or gv, or png, or txt... svg fi +le looks reasonably good in a browser and you can zoom it a loot $plot->as_svg("my_big_plot.svg"); system("iceweasel my_big_plot.svg"); [download] something like this, I warn you that in real life this is not so simple and this is only an skeleton and WILL fail for sure until you work and tune this a little, but you can explore this idea in any case, specially if you feel comfortable with dot files.	[reply] [d/l]
Re^4: Bucketing,Slicing and Reporting data across multiple dimensions by Voronich (Hermit) on Aug 17, 2011 at 20:36 UTC
hey thanks very much. I'm sufficiently familiar with dot files from Doxygen in my C++ stuff, so this isn't going to be SO out there. I'll definitely pick this up, noodle with it and let you know how it goes. o/ UPDATE:Yes, the last column is just the difference between the two test runs (the previous two columns) so it measure the impact of the other changes that were made between the baseline and the test. Me	[reply]
Re^5: Bucketing,Slicing and Reporting data across multiple dimensions by pvaldes (Chaplain) on Aug 17, 2011 at 22:22 UTC
Re^2: Bucketing,Slicing and Reporting data across multiple dimensions by Voronich (Hermit) on Aug 17, 2011 at 18:09 UTC
That's... sick and delightful. I probably won't go that route. But I'm going to keep that idea in my bag of tricks as it will almost certainly come up before too terribly long. Me	[reply]