martiLQ/docs/source/who.md

39 lines
1.8 KiB
Markdown
Raw Permalink Normal View History

2021-12-12 12:14:23 +00:00
# Who is likely to use martiLQ
2021-10-08 21:38:33 +00:00
2021-10-14 10:50:55 +00:00
You are likely to find the **martiLQ** framework relevant if you:
2021-10-08 21:38:33 +00:00
1. Have many document exchanges, such as End of Day batches
2021-10-08 21:38:33 +00:00
2. Need to verify or reconcile the documents
2021-12-12 12:14:23 +00:00
## Data exchanges
2021-10-08 21:38:33 +00:00
If you are creating or receiving many documents or files on a regular basis
then you probably have some framework defined. The framework may be as simple as:
1. The files are placed in given folders that have significance, such as the source or topic
2. File names have a naming standard, such as subject domain and date of extract
Simple framework such as the above have limitations, such as:
* File names becoming long and need special parsing, with associated testing
* Risk of overwriting
* New folders need to be created for new sources
* Require constant polling, if passive
* Lower automation prospects and alignment to DataSecOps
* Poor fit to web applications (they tend to be designed for FTP and LAN)
2021-12-12 12:14:23 +00:00
## Framework Sidecar files
2021-10-08 21:38:33 +00:00
2021-10-14 10:50:55 +00:00
The **martiLQ** framework addresses the issues and limitations by using sidecar
2021-10-08 21:38:33 +00:00
or shadow files. The [concept of sidecar files](https://en.wikipedia.org/wiki/Sidecar_file) is
not new and are commonly found associated to media file processing.
Sidecar files can also be implemented as ``forks`` and built into the operating system, such as
in Mac OS X HFS. The Microsoft NTFS supports Alternate Data Streams to achieve a similar outcome.
Unfortunately this information is not transferrable to other systems.
2021-12-12 12:14:23 +00:00
The proposition is to define a format for the sidecar file and provide common library tools that
can be be used on multiple platforms when exchanging documents / files. Multiple documents can be
2021-12-12 12:14:23 +00:00
defined in a single **martiLQ** definition which adds to efficiency and productivity if used
for End of Day or similar batches - or even single file transfers.