Opened 6 years ago

Last modified 6 years ago

#871 new enhancement

Use SQLite as Formaline back-end

Reported by: Erik Schnetter Owned by:
Priority: major Milestone:
Component: EinsteinToolkit thorn Version:
Keywords: Cc:


Use SQLite as Formaline back-end instead of storing the information in ASCII files.

Attachments (0)

Change History (3)

comment:1 Changed 6 years ago by Roland Haas

Using SQLite (or any non-ascii data storage) requires extra tools to be present to access the information. Therefore my preference would be to avoid them unless the amount or size of data clearly requires it.

comment:2 Changed 6 years ago by Erik Schnetter

ASCII data also require tools to access the data. Opening a file in an editor is fine, but is not useful for any kind of post-processing. SQLite is a standard tool that a really easy to install and use. XML would be another approach, but is significantly more difficult to process. (For example, to modify the state written into a file, one has to read the file, parse all entries, modify the internal data structure, and then write out the file again -- presumably much slower than just a call to SQLite.)

What kinds of analysis post-processing are you performing on Formaline's output? Are you using particular tools? Have you experimented with saving or combining these output files?

comment:3 Changed 6 years ago by Roland Haas

I am not doing anything with the Formaline output other than looking at it. I am speaking out of my experience when Firefox switched from storing cookies in a plain text file to storing them in an sqlite database (and I wanted to transfer cookies from firefox to wget). Yes the tools are in principle available but they are still harder to learn than an editor or a set of perl/awk/python regular expressions to extract a single item. Doing large amounts of data manipulation might be quite different. Jus speaking for myself: I have no experience at all using sqlite (either its command line tools or SQL itself) but feel confident parsing even moderately complicated ascii files with tools I feel comfortable with. So my point was not so much as to what is technically better (a structured database clearly beats an unstructured ASCII file) but more of what I myself would expect user to be able to work with. I have no real strong preference since I can just continue to more or less ignore these file the way I do right now :-)

Modify Ticket

Change Properties
Set your email in Preferences
as new The ticket will remain with no owner.
Next status will be 'review'.
as The resolution will be set.
to The owner will be changed from (none) to the specified user.
Next status will be 'confirmed'.
The owner will be changed from (none) to anonymous.

Add Comment

E-mail address and name can be saved in the Preferences.

Note: See TracTickets for help on using tickets.