Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pathological DFDL Parser behavior #63

Open
mbeckerle opened this issue Nov 14, 2024 · 0 comments
Open

Pathological DFDL Parser behavior #63

mbeckerle opened this issue Nov 14, 2024 · 0 comments
Labels
DFDL 2.0 For issues associated with DFDL v2.0 (next major revision)

Comments

@mbeckerle
Copy link
Collaborator

DFDL is (we believe) a finite, non-turing complete language. But, DFDL schemas have been created that can construct an infoset that for input data of size N, create a super-exponentially larger infoset than N.

See https://github.com/OpenDFDL/examples/tree/master/superexp where the README.md file explains the issue.

This behavior is unintuitive. People expect that for data of size N and a schema of size S that the infoset can at worst be O(NS).


Bradd K mentioned that customers use the transformation capabilities of DFDL to create and populate structures that are different from the input format, and in unparsing to populate the output from structures that are different.

So any solution to the pathological DFDL behavior problem can't prevent these kinds of transformations since users are depending on them.

However, there is nothing that requires creation of non-linearly larger structures.

@mbeckerle mbeckerle added the DFDL 2.0 For issues associated with DFDL v2.0 (next major revision) label Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DFDL 2.0 For issues associated with DFDL v2.0 (next major revision)
Projects
None yet
Development

No branches or pull requests

1 participant