I am working on a plugin for an existing web-based tool in JavaScript. We are collecting data and store it in a string like this: "2.545,3.552,8.568;2.553,9.898,6.542;..." and so on.
The problem is, that we reach an export limit of 64k characters too fast. I wanted to ask - and excuse me if it is a dumb question - if someone knows of an algorithm or method we could use to press the string before we export it. I am sure that it is technically possible but it certainly exceeds my skills as a programmer.
Thanks for any tips, link or suggestion.
I am working on a plugin for an existing web-based tool in JavaScript. We are collecting data and store it in a string like this: "2.545,3.552,8.568;2.553,9.898,6.542;..." and so on.
The problem is, that we reach an export limit of 64k characters too fast. I wanted to ask - and excuse me if it is a dumb question - if someone knows of an algorithm or method we could use to press the string before we export it. I am sure that it is technically possible but it certainly exceeds my skills as a programmer.
Thanks for any tips, link or suggestion.
Share Improve this question asked Nov 14, 2018 at 23:53 HenryChinaskiHenryChinaski 1671 gold badge2 silver badges8 bronze badges 20- 1 Possible duplicate of How to press a string? – Markus Safar Commented Nov 15, 2018 at 0:05
- I might should have mentioned that I am an amateur programmer, not familiar with web programming in general. As I said, sorry if it is a dumb question. @MarkusSafar Thanks for the link. I actually found this when I googled the question but I wasn't sure if it is really the same one. The OP asked something about a "SVG path String" and I am unfamiliar with that term. Maybe I should ask the question somewhere more appropriate for noobs? I dont really understand how I would implement such a solution. – HenryChinaski Commented Nov 15, 2018 at 0:12
- @HenryChinaski, SVG path String just means that the OP has a string which contains path data from the SVG format. However the problem seems to be the same as your goal is to press data which is stored in a string. Therefore you need some kind of pression algorithm and the linked question contains a bunch of answers pointed to them. So I hope this helps you ;-) – Markus Safar Commented Nov 15, 2018 at 0:16
- Thanks @MarkusSafar! The Huffmann JavaScript Compression looks promising, but even the author states that JavaScript based pression is very slow in general. If I try it on his web page the site just freezes. So maybe someone can tell me if this is a bad idea in general? – HenryChinaski Commented Nov 15, 2018 at 0:17
- 1 @AbanaClara Thanks anyway for the hint with web workers! – HenryChinaski Commented Nov 15, 2018 at 0:39
3 Answers
Reset to default 7lz-string looks like it will work.
var string = "2.545,3.552,8.568;2.553,9.898,6.542";
alert("Size of sample is: " + string.length);
var pressed = LZString.press(string);
alert("Size of pressed sample is: " + pressed.length);
string = LZString.depress(pressed);
alert("Sample is: " + string);<script src="https://cdn.jsdelivr/gh/pieroxy/lz-string/libs/lz-string.js"></script>You can use fflate to Zip/Unzip a string.
In your HTML code add :
<script src="https://unpkg./[email protected]"></script>
In your JavaScript code add :
function zip_encode(str) {
const ascii = encodeURIComponent(str)
const array = new TextEncoder().encode(ascii)
const zip = fflate.deflateSync(array, {level: 9})
return window.btoa(String.fromCharCode(...zip))
}
function zip_decode(base64) {
const raw = window.atob(base64)
const array = Uint8Array.from(raw, c => c.charCodeAt(0))
const unzip = fflate.inflateSync(array)
const ascii = new TextDecoder().decode(unzip)
return decodeURIComponent(ascii)
}
This code should work efficiently for most use cases.
function zip_encode(str) {
const ascii = encodeURIComponent(str)
const array = new TextEncoder().encode(ascii)
const zip = fflate.deflateSync(array, {level: 9})
return window.btoa(String.fromCharCode(...zip))
}
function zip_decode(base64) {
const raw = window.atob(base64)
const array = Uint8Array.from(raw, c => c.charCodeAt(0))
const unzip = fflate.inflateSync(array)
const ascii = new TextDecoder().decode(unzip)
return decodeURIComponent(ascii)
}
// Example usage
const example = "Hello, this is a sample '