Every line of a SAP ORDERS05 IDoc gets its customer order back

Goal Read a SAP customer's order IDocs, one row per order line, with no middleware.

A customer's SAP writes its orders as ORDERS05 IDocs, in a flat file. The order sits at the top of the IDoc, the article further down.

sixteen records cut at their position;
each line with its order, quantity and unit;
an IDoc with no order does not take the previous one's.

lumnik Open
Order desk
EDI
SAP
Connector
Entity

ORDERS05_20261022.txt

EDI_DC40  1000000000004711001740 3022  ORDERS05                                                    ORDERS                                                                                                                                                                                                                                                                                                                                                                                                                                   
E2EDK01                       100000000000471100100000100000002    EUREUR                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
E2EDK02                       1000000000004711001000002000000020014500012345                               20261022                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    
E2EDK02                       100000000000471100100000300000002002SO-77120                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
E2EDP01                       100000000000471100100000400000002000010     120.000        PCE                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
E2EDP19                       100000000000471100100000500000403001CX-889-BLUE                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
E2EDP19                       100000000000471100100000600000403002ART-10442                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
E2EDP01                       100000000000471100100000700000002000020     48.500         KGM                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
E2EDP19                       100000000000471100100000800000703002ART-20017                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
E2EDS01                       1000000000004711001000009000000020023                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    
EDI_DC40  1000000000004711002740 3022  ORDERS05                                                    ORDERS                                                                                                                                                                                                                                                                                                                                                                                                                                   
E2EDK01                       100000000000471100200000100000002    EUREUR                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
E2EDK02                       100000000000471100200000200000002002SO-77121                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
E2EDP01                       100000000000471100200000300000002000010     6.000          PCE                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
E2EDP19                       100000000000471100200000400000303002ART-10442                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
E2EDS01                       1000000000004711002000005000000020023

manifests/10-idoc.yaml

apiVersion: connectors.lumnik.io/v1kind: Connectormetadata:  name: scenario-idoc-b  connector_type: csv-file  scopes: [order-desk-b]spec:  transport:    kind: local    path: /tmp/lumnik-scenario/sap-idoc-orders/b/*.txt   # the customer's SAP writes ORDERS05 IDocs as flat files  parser:    lines: true                    # one record per line, fixed width, no separator  after_process: none  mapping:    cell:      - regex-extract: { column: line, required: true, pattern: "^(\\S+)", groups: { 1: segment } }   # EDI_DC40 or E2…      - regex-extract:             # DOCNUM after TABNAM + MANDT (control record) or SEGNAM + MANDT (data record), then SEGNUM;          column: line             # one pattern for both: a second regex-extract would write null where it misses          pattern: "^(?:EDI_DC40.{5}|E2.{31})(\\d{16})(\\d{6})?"          groups: { 1: docnum, 2: segnum }      - regex-extract: { column: line, pattern: "^E2EDK02 {23}.{33}001(.{35})", groups: { 1: po_number } }   # the buyer's PO      - regex-extract:             # an item: POSEX, then MENGE and MENEE          column: line          pattern: "^E2EDP01 {23}.{33}(.{6}).{5}(.{15})(.{3})"          groups: { 1: item, 2: quantity, 3: unit }      - regex-extract: { column: line, pattern: "^E2EDP19 {23}.{33}(\\d{3})(.{35})", groups: { 1: qualifier, 2: material } }      - clean: { columns: [po_number, quantity, unit, material], strip: true }      - default: { column: segnum, value: "000000" }                  # the control record has none      - parse-number: { column: quantity, decimal-separator: "." }    # 120.000 is 120      - fill-down: { columns: [po_number], reset-when: { column: segment, in: [EDI_DC40] } }                    # the PO, on its IDoc      - fill-down: { columns: [item, quantity, unit], reset-when: { column: segment, in: [EDI_DC40, E2EDP01, E2EDS01] } }   # the item, on its E2EDP19

$ lm apply -f 10-idoc.yaml
Applied connector "scenario-idoc-b" — 1 endpoint

$ lm connector run scenario-idoc-b
run scheduled: 4100805d-22c2-443f-8bd7-adc3133986c7

$ lm run get 4100805d-22c2-443f-8bd7-adc3133986c7
ID        CONNECTOR        ENDPOINT  STATUS     IN  OUT  SKIPPED  DEAD-LETTERS  STARTED           ENDED
4100805d  scenario-idoc-b  default   Completed  16  16   0        0             2026-11-03 16:10  2026-11-03 16:10

manifests/20-idoc-record.yaml

kind: Entityname: idoc_record_blabel: Enregistrement IDocdescription: "One record of an ORDERS05 IDoc, in file order: its segment, and the purchase order and item it belongs to."match: [docnum, segnum]scopes: [order-desk-b]columns:  docnum: { label: "IDoc" }  segnum: { label: "N°" }  segment: { label: "Segment" }  po_number: { label: "Commande client" }  item: { label: "Poste" }  qualifier: { label: "Qualifiant" }  material: { label: "Article" }  quantity: { label: "Quantité" }  unit: { label: "Unité" }sources:  - table: t_scenario_idoc_b    map: { docnum: docnum, segnum: segnum, segment: segment, po_number: po_number, item: item, qualifier: qualifier, material: material, quantity: quantity, unit: unit }

$ lm entity apply -f 20-idoc-record.yaml
Applied entity "idoc_record_b" → connector."v_idoc_record_b"

$ lm entity get idoc_record_b
DOCNUM            SEGNUM  SEGMENT   PO_NUMBER   ITEM    QUALIFIER  MATERIAL     QUANTITY  UNIT  _CONFLICTS
0000000004711001  000000  EDI_DC40                                                              {}
0000000004711001  000001  E2EDK01                                                               {}
0000000004711001  000002  E2EDK02   4500012345                                                  {}
0000000004711001  000003  E2EDK02   4500012345                                                  {}
0000000004711001  000004  E2EDP01   4500012345  000010                          120       PCE   {}
0000000004711001  000005  E2EDP19   4500012345  000010  001        CX-889-BLUE  120       PCE   {}
0000000004711001  000006  E2EDP19   4500012345  000010  002        ART-10442    120       PCE   {}
0000000004711001  000007  E2EDP01   4500012345  000020                          48.5      KGM   {}
0000000004711001  000008  E2EDP19   4500012345  000020  002        ART-20017    48.5      KGM   {}
0000000004711001  000009  E2EDS01   4500012345                                                  {}
0000000004711002  000000  EDI_DC40                                                              {}
0000000004711002  000001  E2EDK01                                                               {}
0000000004711002  000002  E2EDK02                                                               {}
0000000004711002  000003  E2EDP01               000010                          6         PCE   {}
0000000004711002  000004  E2EDP19               000010  002        ART-10442    6         PCE   {}
0000000004711002  000005  E2EDS01                                                               {}

$ lm entity get idoc_record_b --filter segment=E2EDP19 --filter qualifier=002
DOCNUM            SEGNUM  SEGMENT  PO_NUMBER   ITEM    QUALIFIER  MATERIAL   QUANTITY  UNIT  _CONFLICTS
0000000004711001  000006  E2EDP19  4500012345  000010  002        ART-10442  120       PCE   {}
0000000004711001  000008  E2EDP19  4500012345  000020  002        ART-20017  48.5      KGM   {}
0000000004711002  000004  E2EDP19              000010  002        ART-10442  6         PCE   {}

Limits

A second regex-extract writing the same column writes null where it does not match: DOCNUM is read by one pattern.
The lines are a filtered reading of the records: an item with no E2EDP19 002 has no line.
Synthetic file, simplified layout, fictitious orders and articles.

Sales · SAP

The customer sends orders as IDocs.

A flat file, fixed width.

Two ORDERS05 IDocs

The problem

The order is far from the article.

The number in E2EDK02.
The article in E2EDP19, further down.

What is not changed

The customer's SAP stays as it is.

Its file, its format.
No middleware.

The trap

An IDoc with no order number.

It must not take the one before.
Or the line lands on the wrong order.

What had to be written

reset-when: { in: [EDI_DC40] }

One line.

The number restarts at each IDoc.
Each line keeps its order.
A 50-line scenario, two manifests.

The result

Three order lines.

ART-10442 × 120 PCE, ART-20017 × 48.5 KGM.
The second IDoc stays with no number.

The limit

An item with no article has no line.

The lines are a filtered read of the records.

Try it

The scenario replays locally.

Every step is published with its output.

This scenario runs on lumnik Open, free and open source.

Try lumnik Open →