I have become a bit more greedy if you can help that would great. I din't created separate thread as I though that would be again re-work

there is some addition in log structure and one more separate script is needed for that

 
0317 09:53:14.865+0000 {12772} INFO  [pm-worker-exec slot-Task:id=8274
+,env=12772,type=11][c.s.w.t.f.s.PostExecutionStage  ] Loaded {child r
+unId vs completion type}: {10418-SUCCESSFUL}{10419-SUCCESSFUL}{8288-S
+UC
+CESSFUL}{8289-SUCCESSFUL}{8290-SUCCESSFUL}{8291-SUCCESSFUL}{8292-SUCC
+ESSFUL}{8293-SUCCESSFUL}{8294-SUCCESSFUL}{8295-SUCCESSFUL}{8296-SUCCE
+SSFUL}
0427 10:04:55.735+0000 {12772} INFO  [m-worker-exec slot-Task:id=10418
+,env=12772,type=55][c.s.c.d.i.OutputDataExtractor   ] Started consumi
+ng output for identifier: PRIMARY_DATASET
0427 10:04:56.040+0000 {12772} INFO  [m-worker-exec slot-Task:id=10418
+,env=12772,type=55][c.s.c.d.i.OutputDataExtractor   ] Done consuming 
+output for identifier: PRIMARY_DATASET 
0427 10:04:50.656+0000 {12772} INFO  [m-worker-exec slot-Task:id=10418
+,env=12772,type=55][c.s.c.d.jobs.JobServerJobManager] Submitted job w
+ith Job id 85c6b503-6181-4744-815c-03a1febbbc7b
0427 10:04:55.734+0000 {12772} INFO  [m-worker-exec slot-Task:id=10418
+,env=12772,type=55][c.s.c.d.jobs.JobServerJobManager] Done killing jo
+b with id 85c6b503-6181-4744-815c-03a1febbbc7b
[download]

Now output is required

Task id,start time,endtime
10418 consuming,10:04:55.735+0000,10:04:56.040+0000
10418 Submitted,0427 10:04:50.656+0000,0427 10:04:55.734+0000
[download]

Try

#!/usr/bin/perl
use strict;

my $infile  = 'worker.log';
open IN,'<',$infile or die "$!";

# input
my %data = ();
while (<IN>) {
  chomp;
  next unless /Task:id=(\d+)/;

  my $taskid = $1;
  my (undef,$timestamp,undef)  = split /\s+/,$_,3;
   
  if (/(Started|Submitted|Done).*(consuming|job)/){
    my $i = ($1 eq 'Done') ? 1 : 0;
    my $proc = ($2 eq 'consuming') ? $2 : 'Submitted';
    $data{$taskid.' '.$proc}[$i] = $timestamp;
  }

}
close IN;

# output
print join ',',('Task id','Start time',"End time\n");
for my $id (reverse sort keys %data){
  printf "%s,%s,%s\n",$id,@{$data{$id}};
}
[download]

poj

thanks it is working but its providing details for all task id but I need it for particular task ids ( of a parent id)

I tried to make changes but still its showing data for all task id

#!/usr/bin/perl
use strict;

my $infile  = 'worker.log';
my $outfile = 'Consumer.CSV';
my @id   = ();
print "Please enter the parentid of running process: \n" ;
my $reqid = <STDIN>;
chop $reqid;
open IN,'<',$infile or die "$!";
# input
my %data = ();
while (<IN>) {
  chomp;
  next unless /Task:id=(\d+)/;

  my $taskid = $1;
  my (undef,$timestamp,undef)  = split /\s+/,$_,3;
   
  if (/(Started|Submitted|Done).*(consuming|job)/){
    my $i = ($1 eq 'Done') ? 1 : 0;
    my $proc = ($2 eq 'consuming') ? $2 : 'Submitted';
    $data{$taskid.' '.$proc}[$i] = $timestamp;
  }
  while ( /\{(\d+)-SUCCESSFUL\}/g ){
    push @id,$1 if ($taskid eq $reqid);
  }

}
close IN;


# output
open OUT,'>',$outfile or die "$!";
my @cols = qw(Taskid Started Done);
printf OUT "%s,%s,%s\n",@cols;
#print join ',',('Task id','Start time',"End time\n");
for my $id (reverse sort keys %data){
  printf OUT "%s,%s,%s\n",$id,@{$data{$id}};
}
[download]