Recent searches
Search options
If you don't mind, could you reply to this toot with something you have accomplished recently? Work, hobby, whatever, but especially if it's something fiddly and technical that required quiet contemplation or problem solving.
Right now my feed is flooded with the omni-catastrophe even more than it was in, like, March of 2020, and I just want (and suspect we could all use) some reminders that progress is still happening and being effective is still possible
@glyph I wrote some generic code in #Rust to convert multi-GB XML files into Parquet without having to load the entire thing into RAM. Derive macros feel like magic once you get the hang of them.
The definitions of the (nearly 100) data object structures in the XML are now pleasingly boilerplate-free:
#[derive(FromXml, ToArrow)]
struct MyObj {
#[from_xml(element = "my-data")]
data: String,
}
With some cleanup it might even be worth open sourcing, if anyone else has a use for it.
@thomastc abandon this feeling of needing to clean up before sharing! nobody expects all their code to be clean
@raylu No, but they might expect OSS to work for more use cases than just mine.
@thomastc it's pretty normal to have a readme saying you wrote it for your personal use
but worrying about other people's expectations for the code seems like a silly reason to not open-source it. there's gonna be someone with unreasonable expectations even after you clean it up