Show HN: SQLFrame – I ran PySpark without Spark on a SQL database https://bit.ly/3Kb1zYv

Show HN: SQLFrame – I ran PySpark without Spark on a SQL database Recently I open-sourced SQLFrame, a DataFrame library that implements the PySpark DataFrame API but removes Spark as a dependency. It does this by generating the corresponding SQL for the DataFrame operations using SQLGlot. Since the output is SQL this also means that the PySpark DataFrame API can now be used directly against other databases without the Spark middleman. I built this because of two common problems I have faced in my career: 1. I prefer to write complex pipelines in PySpark but they can be hard to read for SQL-proficient co-workers. Therefore I find myself in a tradeoff between maintainability and accessibility. 2. I really enjoy using the PySpark DataFrame API but not every project requires Spark and therefore I'm not able to use the DataFrame library I am most proficient in. The library currently focuses on transformation pipelines (reading from and writing to tables) and data analysis as key use cases. It does offer some ability to read from files directly but they must be small although this can be improved over time if there is demand for it. SQLFrame currently supports BigQuery, DuckDB, and Postgres with Clickhouse, Redshift, Snowflake, Spark, and Trino in development or planned. You can use the "Standalone" session to test running against any engine supported by SQLGlot but there could be issues with more advanced functions that will be resolved once officially supported by SQLFrame. Blog post for more details: https://bit.ly/44Ssm5o... Would love to answer any questions or hear any feedback you may have! https://bit.ly/3yl2GSD May 21, 2024 at 02:09AM

Show HN: Recall Memory – Your Personal Local Time Machine for Mac https://bit.ly/3V6eZva

Show HN: Recall Memory – Your Personal Local Time Machine for Mac Recall Memory is a free Sandboxed Mac App which let's you scroll through time and allows you to "Recall" what you were doing earlier. Recall works by capturing the active window every second and only saves screenshots with significant changes. Making it easy to scroll through what you were doing earlier. All data is processed and always stored locally. https://bit.ly/44NzAYr May 21, 2024 at 12:48AM

Show HN: Find and Grab Domains with a Past https://bit.ly/4bpbO7y

Show HN: Find and Grab Domains with a Past I created a micro-service called [Gone.Domains]( https://bit.ly/3X6yw03 ). It allows users to obtain a list of outgoing domains from a website. The report will highlight domains that are expired or nearing expiration. This service can help users find domains with a history for new projects or for resale. May 20, 2024 at 07:48AM

Show HN: I Built an AI Holiday Planner for Instant, Expert-Level Itineraries https://bit.ly/3KtptyJ

Show HN: I Built an AI Holiday Planner for Instant, Expert-Level Itineraries Hi HN, I'm Fran! I'm excited to share my latest project with you all. I built an AI travel planner that generates custom travel itineraries in seconds. Whether you're planning a weekend getaway or a month-long adventure, this tool can create a detailed, professional-level plan that includes day-by-day activities, hotels, restaurants, and more. As a frequent traveler, I wanted to create something that simplifies the overwhelming task of trip planning and ensures you make the most of your time at any destination. The AI considers various factors to provide recommendations that suit your preferences and interests. I'd love to hear your feedback and suggestions. Feel free to ask any questions or share your experiences with travel planning! Thanks for checking it out, Fran https://bit.ly/3X6x6Th May 20, 2024 at 07:28AM

Show HN: DeLorean – Super Performant IPv4->IPv6 Reverse Proxy in Golang https://bit.ly/44VLUWE

Show HN: DeLorean – Super Performant IPv4->IPv6 Reverse Proxy in Golang https://bit.ly/44QKeO2 May 20, 2024 at 03:55AM

Show HN: ffmpeg-english "capture from /dev/video0 every 1 second to jpg files" https://bit.ly/3K6eECv

Show HN: ffmpeg-english "capture from /dev/video0 every 1 second to jpg files" https://bit.ly/4dOo8jq May 20, 2024 at 12:50AM

Show HN: Digital player board for Terraforming Mars https://bit.ly/4bDY2OF

Show HN: Digital player board for Terraforming Mars My cousin and I love the Terraforming Mars board game. But we'd often get overly excited and knock our pieces off of our boards, losing track of our progress. So I digitised it. It comes with a few cool features like resource conversions (e.g. converting plants to greenery), production phase, offline, mobile-friendly and keeps track of the history using the browser history itself. Sharing this here in case there are any other TM fans that could also find some use in this :) https://bit.ly/3WHU1E5 May 19, 2024 at 01:00PM

Show HN: Interactive Graph by LLM (GPT-4o) https://bit.ly/3K8UOq8

Show HN: Interactive Graph by LLM (GPT-4o) https://bit.ly/3HzH1Ik May 19, 2024 at 09:46AM

Show HN: Open-source GeForce NOW alternative with Stadia's social features https://bit.ly/3UNvZoH

Show HN: Open-source GeForce NOW alternative with Stadia's social features https://bit.ly/3UV4Iki May 19, 2024 at 03:18AM

Show HN: I built a bot to handle my Rejection Sensitivity Dysphoria (RSD) https://bit.ly/3QVmaUn

Show HN: I built a bot to handle my Rejection Sensitivity Dysphoria (RSD) I built a bot to handle my RSD because I was procrastinating to find a therapist https://bit.ly/3WMOSup May 18, 2024 at 10:47PM

Show HN: I made a task-logging RPG-style website for developers https://bit.ly/4dKhz10

Show HN: I made a task-logging RPG-style website for developers I built a site where developers can log tasks, gain experience, and level up. There are also Boss Battles once a week on Fridays (UTC) for extra XP. https://bit.ly/3ww8bgZ May 17, 2024 at 06:03PM

Show HN: ChatFabrica, AI-First Customer Service Chatbot https://bit.ly/3ULg36i

Show HN: ChatFabrica, AI-First Customer Service Chatbot https://bit.ly/44K2rNb May 18, 2024 at 09:38AM

Show HN: We are building an open-source Salesforce https://bit.ly/44PcX5C

Show HN: We are building an open-source Salesforce https://bit.ly/44PcYGI May 18, 2024 at 06:05AM

Show HN: GitHub – I tried to build AWS S3 from scratch https://bit.ly/3UE8e2c

Show HN: GitHub – I tried to build AWS S3 from scratch Over the past few years I’ve been thinking about how I could build SaaS and deploy it on my own infrastructure without needing to use any cloud platforms like AWS or GCP. In this repo I document my progress on building a clone of AWS S3 that functions the same as S3 using an exclusively open-source technology stack. https://bit.ly/3K4xYA3 May 18, 2024 at 02:04AM

Show HN: I have built a UI Auditor Tool that gives suggestions on web/app design https://bit.ly/4bcS0Eh

Show HN: I have built a UI Auditor Tool that gives suggestions on web/app design https://bit.ly/4bm0FnR May 17, 2024 at 12:30PM

Show HN: I built an image optimization tool based on Google's new Jpegli encoder https://bit.ly/3QTfHt5

Show HN: I built an image optimization tool based on Google's new Jpegli encoder https://bit.ly/4ap9ko8 May 17, 2024 at 08:03AM

Show HN: Autopilot for my little HTML game called Andromeda Invaders https://bit.ly/3WJYoOL

Show HN: Autopilot for my little HTML game called Andromeda Invaders https://bit.ly/4axEaMI May 15, 2024 at 11:50AM

Show HN: I made an app to make podcasts out of your reading list https://bit.ly/4ahIMW4

Show HN: I made an app to make podcasts out of your reading list hey folks - i made an ios app to make summarized audio from articles that i don't have time to read (or i'm not sure is worth my time quite yet). to try it out: 1. go to the website 2. click early access button 3. submit the form (only 4 questions) on the confirmation page after you submit the form, you'll see a link to download the beta app via testflight. i haven't spent much time on the landing page, marketing materials, etc. the app is still in beta, but i appreciate all feedback including: the app functionality, design, how it solves people's problems, use cases, feature requests, bugs, etc! the stack is relatively simple - a native ios front end supported by a node.js server. i'm using firebase for easy auth/database and google cloud for storage. this is the first app i built in native ios (swiftui)! https://bit.ly/3yueUs8 May 16, 2024 at 04:57AM

Show HN: Apple Music Electron https://bit.ly/3QMaQde

Show HN: Apple Music Electron Hello, I've been building an Apple Music client for the past few months, and I released it a few weeks ago. Enjoy! We're currently having issues with playback https://bit.ly/3QMaQKg https://bit.ly/3yklscR May 16, 2024 at 04:43AM

Show HN: I made a simple but powerful deployment tool https://bit.ly/3WI99RW

Show HN: I made a simple but powerful deployment tool Been using it for about a year now in production, but rewrote it completely in golang. My first go project so far. I wanted to have something that would make my life easier. A lot of tools nowaday kinda push you towards functional deployments and that usually doesn't work for me since I like stuff like LiveView by Phoenix and Websocket stuff in general. Old vercel deployments back when they allowed to deploy docker containers was a godsend, but since they don't offer that anymore I had to use services like fly.io(which is amazing) or heroku. However I wanted something selfhosted that I could just grab any VPS and use it, not being reliant on any one party for hosting, CI\CD, maintanence or anything really and so far it's going great. Hosting some small to medium sized projects using this little fella. Would be cool if yall would look at it and tell me what you think. Comments on my code also would be very welcome, go turned out to be very cool and I wanna try more stuff with it I was thinking to maybe use docker swarm to make it horizontally scalable, but it feels like such an overkill, wdyt? https://bit.ly/4bEo57F May 15, 2024 at 11:15PM