RKV
@rkv2401.bsky.social
Software Engineer. Python, Antlr. Masters in Comp Sci (AI).
Reposted by RKV
Similar strategy I've used many times to great effect. I may have stolen this phrasing from @jdlong.cerebralmastication.com
#dataBS
#dataBS
December 13, 2024 at 5:45 PM
Similar strategy I've used many times to great effect. I may have stolen this phrasing from @jdlong.cerebralmastication.com
#dataBS
#dataBS
Update 2 - I ended up using SQLGlot as a formatter. The style of the generated code is consistent, and it is very fast (less than a minute to format a 5.8MB file).
Update - I tried SQLFluff on a file with 100k lines (2.5MB) and it didn't crash, but it took over 4 hours just to lint. Too slow for my use case, so I have to find something else.
November 20, 2024 at 7:17 AM
Update 2 - I ended up using SQLGlot as a formatter. The style of the generated code is consistent, and it is very fast (less than a minute to format a 5.8MB file).
Does anyone know of a good linter like SQLFluff that can be run from CLI, but is also suitable for bigger files? The default limit for SQLFluff is 20KB, and while this limit can be overridden, I will be working with files more than 100x larger than that and don't want to risk any crashes. #dataBS
November 18, 2024 at 6:59 AM
Does anyone know of a good linter like SQLFluff that can be run from CLI, but is also suitable for bigger files? The default limit for SQLFluff is 20KB, and while this limit can be overridden, I will be working with files more than 100x larger than that and don't want to risk any crashes. #dataBS
Came across this really nice video explaining the intuition behind RoPE (rotary positional embeddings) - www.youtube.com/watch?v=o29P...
Rotary Positional Embeddings: Combining Absolute and Relative
YouTube video by Efficient NLP
www.youtube.com
November 10, 2024 at 6:17 AM
Came across this really nice video explaining the intuition behind RoPE (rotary positional embeddings) - www.youtube.com/watch?v=o29P...