2 Commits

Author	SHA1	Message	Date
Bang NGUYEN	dc49249d36	[Attempt #2] String overflow hash + data/mem optimization (#356) ... * Use graal * Use dynamic cores computer * Use stream API to cleanup code * Use max processors * Use hash to avoid init string * optimize concurrentmap init * Smaller hash size * Avoid checking concurrentmap * Optimize data type * string dedup * Faster write * Change base * Remove time * Use mul instead of div	2024-01-13 12:32:17 +01:00
Bang NGUYEN	af1946fcb5	[Attempt 1] Memory mapping + split by linebreak + multithreads + fast double parser (#330) ... * Create clones * Cleanup code and add memory mapping to read file * Fix chunks reading logic to fit linebreak * Remove unused * Sequential * Multi thread process chunks * Add new line in output * Remove unnecessary operation with map & reducer memory * Reduce mem usage by using only 1 map * formatting * Remove unnecessary length check * Remove trycatch * Optimize double parsing	2024-01-12 09:35:35 +01:00