Package es.ehu.si.ixa.prebmt.model.filebacked

Provides file-backed implementations of those interfaces in the domain model that typically require of large structures of data.

See: Description

Package es.ehu.si.ixa.prebmt.model.filebacked Description

Provides file-backed implementations of those interfaces in the domain model that typically require of large structures of data.

The CorpusAlignment, MonolingualCorpus and BilingualCorpus are implemented in this package in such a way that they are backed by files, loading their content into the main memory on demand. This makes them more memory efficient, but also more I/O intensive. In general terms, these implementations should be preferred over their in-memory counterparts as they offer better performance, but they could turn problematic when used through slow I/O media (like network mounted storage). The fact that the provided implementations are file-backed also makes them persistent, which means that they can generally be initialized from these files once they are created instead of building them from scratch. Generating the files is usually the most expensive operation by far, so it is recommended to create them once and reuse the same files in subsequent usages.