in reply to Re^2: Keeping Order with YAML::XS
in thread Keeping Order with YAML::XS

Why do you say that the input is creating what you're expecting? The in.yaml you give above produces: 
{
  arguments => [{ value => "test" }],
  options => [
    { param => "i", value => 1001 },
    { param => "f" },
    { param => "x", value => "eyes" },
  ],
  path => "/export/home/frank",
}

[download]

IE. the top level items (arguments,options,path) are in a hash, which is an unordered set in Perl. You've lost your ordering on input, not on output. Unless you're talking about the options? In which case both formats are equivalent, at least to the YAML::XS loader which creates the same data structures in both cases.

In what external context does the yaml produced by YAML::XS cause a problem? Because both formats generate the same data structures in Perl and therefore should be interchangeable without issue.

Replies are listed 'Best First'.
Re^4: Keeping Order with YAML::XS
by walkingthecow (Friar) on Jul 29, 2013 at 08:08 UTC
    Ahhh, yes! But, here's the thing. How do I create a data structure that is ordered. I mean, I realize that hashes are unordered, but I'd like to create an ordered YAML sequence from a data structure. The problem is, an ordered YAML sequence looks the same Perl hash structure wise (from input) as an unordered YAML on output. I need the YAML to be ordered, and my issue is creating the data structure that makes that.
[reply]

      I would think that using a pure Perl YAML encoder together with Tie::IxHash should keep the order of the keys. See AM's reply below, that doesn't seem to work :-(

      If your data structure is reasonably fixed, you might even get through by using a text template and filling in the values. Usually that means having a machine-readable data schema to generate the template first.

[reply]

      The ordered data structure you're dreaming of is an array. It is an ordered sequence and there is an example of it in the data structure created when parsing either YAML format of the data in question. If you want to create an ordered sequence in the YAML output, use a Perl array.

      From YAML spec 1.2:

      # Ordered maps are represented as
# A sequence of mappings, with
# each mapping having one key
--- !!omap
- Mark McGwire: 65
- Sammy Sosa: 63
- Ken Griffy: 58

      [download]

      Which produces this Perl data structure

      [
  { "Mark McGwire" => 65 },
  { "Sammy Sosa" => 63 },
  { "Ken Griffy" => 58 },
]

      [download]

      So lets duplicate that with your data

      [
  { path => "/export/home/frank" },
  {
    options => [
      { param => "i", value => 1001 },
      { param => "f" },
      { param => "x", value => "eyes" },
      {},
      { param => "b", value => "toes" },
      { param => "p" },
    ],
  },
  { arguments => [{ value => "test" }] },
]

      [download]
      Which produces the format suggested by the YAML spec: 
      ---
- path: /export/home/frank
- options:
  - param: i
    value: '1001'
  - param: f
  - param: x
    value: eyes
  - {}
  - param: b
    value: toes
  - param: p
- arguments:
  - value: test

      [download]

      So we see how to create ordered mappings in both YAML and in Perl. YAML::XS is doing exactly the right thing because Perl hashes are not ordered, therefore it outputs them as unordered mappings. So the real question is which Perl data structure you're going to use to represent Ordered Mappings, because Perl hashes can't do that job and arrays of individual hashes aren't convenient.

      Several people have suggested Tie::IxHash and this is a very good choice. But since YAML::XS sees it as just a regular hash, it outputs in unordered YAML notation. You will have to preprocess your data structures to convert IxHash's into arrays of individual mappings and reverse the process when loading.

[reply]
[d/l]
[select]
        YAML::XS and YAML::Tiny both clearly sort keys 
        $ perl -le " my %f = qw/ path 1  options 1 arguments 1 /; print join q
+/ /, keys %f; "
options arguments path

$ perl -le " my %f = qw/ path 1  options 1 arguments 1 /; print join q
+/ /, sort keys %f; "
arguments options path

        [download]

        No other way to get arguments options path 

        $ perl -le " my %f = qw/ arguments 1 options 1 path 1 /; print join q/
+ /, keys %f; "
options path arguments

$ perl -le " my %f = qw/ arguments 1 options 1 path 1 /; print join q/
+ /, sort keys %f; "
arguments options path

        [download]
[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom