Re: Perl Program to efficiently process 500000 small files in a Directory (AIX)

Replies are listed 'Best First'.
Re^2: Perl Program to efficiently process 500000 small files in a Directory (AIX) by Anonymous Monk on Mar 17, 2018 at 14:14 UTC
I reran it commenting out the "Move". it took 1 hour and 20 minutes to process 467,000 files.	[reply]
Re^3: Perl Program to efficiently process 500000 small files in a Directory (AIX) by poj (Abbot) on Mar 17, 2018 at 14:43 UTC
How big are the files in bytes ?. Can you post and example of one ? poj	[reply]
Re^4: Perl Program to efficiently process 500000 small files in a Directory (AIX) by DenairPete (Novice) on Mar 17, 2018 at 15:28 UTC
Each File is around 350k. Example: `A\|RCPNT_ID\|92299999 A\|RCPNT_TYP_CD\|QL A\|ALERT_ID\|264 A\|FROM_ADDR_TX\|14084007183 A\|RQST_ID\|PT201803989898 A\|CRTEN_DT\|02072018 A\|CHNL_ID\|17 A\|RCPNT_FRST_NM\|TESTSMSMIGRATION A\|SBJ_TX\|Subject value from CDC A\|CLT_ID\|14043 A\|ALRT_NM\|Order Shipped A\|CNTCT_ADDR\|16166354429 A\|RCPNT_LAST_NM\|MEMBER A\|ORDR_NB\|2650249999 A\|LOB_CD\|PBM D\|QL_922917566\|20180313123311\|1\|TESTSMSMIGRATION MEMBER\|\|` [download]	[reply] [d/l]