Show HN: TTop – System monitoring tool with historical data, triggers and TUI https://bit.ly/3qZ9Ngl

Show HN: TTop – System monitoring tool with historical data, triggers and TUI It is not top/htop replacement because of historical snapshots which can help you to find problems back in time https://bit.ly/44G50y9 September 4, 2023 at 04:50PM

Show HN: finetune LLMs via the Finetuning Hub https://bit.ly/3PnIQMB

Show HN: finetune LLMs via the Finetuning Hub Hi HN community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of businesses are starting to entertain the idea of self-hosting LLMs trained on their proprietary data rather than relying on third party APIs. To this point, I am tracking the following 4 pillars of evaluation that businesses are typically look into: - Performance - Time to train an LLM - Cost to train an LLM - Inference (throughput / latency / cost per token) For each LLM, my aim is to benchmark them for popular tasks, i.e., classification and summarization. Moreover, I would like to compare them against each other. So far, I have benchmarked Flan-T5-Large, Falcon-7B and RedPajama and have found them to be very efficient in low-data situations, i.e., when there are very few annotated samples. Llama2-7B/13B and Writer’s Palmyra are in the pipeline. But there’s so many LLMs out there! In case this work interests you, would be great to join forces. GitHub repo attached — feedback is always welcome :) Happy hacking! https://bit.ly/3ElU8uG September 4, 2023 at 04:16PM

Show HN: Rapidgzip – Truly Parallel Gzip Decompression with 10 GB/s https://bit.ly/3PoJJVi

Show HN: Rapidgzip – Truly Parallel Gzip Decompression with 10 GB/s I have posted a much earlier version of this over a year ago [0]. Since then a lot has changed. Obviously, the name has changed. This happened for the paper publication [1]. I have also optimized the speed, integrated ISA-L for special cases, limited the compression-ratio-dependent maximum memory consumption, and finally added parallelized CRC32 computation, which adds ~5% overhead no matter the number of cores used. At this point, I am leaning towards calling it production-ready although there are still many ideas for improvements. Redoing the benchmarks of the older Show HN, would look like this: time pigz -d -c 4GiB-base64.gz | wc -c # real ~13.4 s -> ~320 MB/s time rapidgzip -d -c 4GiB-base64.gz | wc -c # real ~1.26 s -> ~3.4 GB/s However, at this point, the piping itself becomes a problem. Rapidgzip is actually slightly faster than cat when comparing the piped bandwidth! E.g., compare these additional benchmarks: time cat 4GiB-base64.gz | wc -c # real ~1.06 s -> ~3.1 GB/s time fcat 4GiB-base64.gz | wc -c # real ~0.41 s -> ~8.0 GB/s time rapidgzip -o /dev/null -d 4GiB-base64.gz # real ~0.68 s -> ~6.5 GB/s fcat is an alternative cat implementation that uses vmsplice to speed up piping. According to the ReadMe it currently is broken, but it works fine on my system and piping it to md5sum yields consistent results [2]. So, at this point, I/O and actually also allocations have become a limiting factor and if you want full speed, you would have to interface with the rapidgzip library interface directly (in C++ or via the Python bindings) and process the decompressed data in memory. The project ReadMe contains further benchmarks with Silesia and FASTQ data and scaling up to 128 cores, for which rapidgzip achieves 12 GB/s for Silesia and 24 GB/s when an index has been created with --export-index and is used with --import-index. It can also be tested with ratarmount 0.14.0, which now uses rapidgzip as a backend by default for .gz and .tar.gz files [3]. [0] https://bit.ly/3P3MRT2 [1] https://bit.ly/3Evkvhz [2] https://bit.ly/3EItoot [3] https://bit.ly/3hZj1Ba https://bit.ly/3qX04Hi September 4, 2023 at 09:29AM

Show HN: FileSamplesHub – Free sample files to all your testing purposes https://bit.ly/47XFJlT

Show HN: FileSamplesHub – Free sample files to all your testing purposes https://bit.ly/47WLznF September 4, 2023 at 09:18AM

Show HN: The simplest way to validate your idea https://bit.ly/3LavZed

Show HN: The simplest way to validate your idea Real idea (The Facts Clock): https://bit.ly/45Birke https://bit.ly/3sDRfCL September 4, 2023 at 04:44AM

Show HN: MonoDevelop https://bit.ly/3PmczFQ

Show HN: MonoDevelop https://bit.ly/3Emznie September 4, 2023 at 04:51AM

Show HN: FeedsBot – A Meower bot that posts RSS feed updates to groupchats https://bit.ly/3PoH3a8

Show HN: FeedsBot – A Meower bot that posts RSS feed updates to groupchats Hi, HN! I made this awhile back as a Meower[1] bot that posts RSS feed updates to groupchats, and reads RSS feeds, powered by Extractus' Feed Extractor[2][3]. My friend's groupchat uses this bot to post updates to his blog, and he says that it has been working out great. Looking forward to your feedback and suggestions! [1]: https://bit.ly/3L76ASK [2]: https://bit.ly/3Z5rffW [3]: https://bit.ly/3Z4ibaN https://bit.ly/3PoxurO September 4, 2023 at 12:33AM

Show HN: A gem that shows jobs right in the command line https://bit.ly/3sFs8Qd

Show HN: A gem that shows jobs right in the command line It scrapes Ruby/Ruby on Rails jobs from six sites: Gorails, Weworkremotely, Ruby on Remote, Ruby on Rails jobs, Rails Hotwire Jobs, WeAreHiring, and displays them right in your terminal! The scraper lives on: https://bit.ly/3R6iDnh Please comment other sites that you use to look up Ruby/ROR jobs! https://bit.ly/3r2Qq5W September 3, 2023 at 06:40PM

Show HN: Command line query for all your unified log data https://bit.ly/3P0SJyE

Show HN: Command line query for all your unified log data https://bit.ly/3OZJcYx September 3, 2023 at 03:20PM

Show HN: Extract RSS feed from almost anything https://bit.ly/3L5P3u0

Show HN: Extract RSS feed from almost anything Howdy! RSSfeedASAP scratches my own itch. I run a regional podcasting directory which gets dozens of messy submission for podcasts. Often they don't even include an xml file and me being a good samaritan I sometimes do the manual work and find it myself. I got tired of that manual work and decided to build a microapp. RSSfeedASAP is this app and I decided to release it in case someone else finds any use in it. https://bit.ly/3L4KNLq September 3, 2023 at 04:37PM

Show HN: You wanted SMS, you've got it (HN community is awesome) https://bit.ly/3r6p2UC

Show HN: You wanted SMS, you've got it (HN community is awesome) The HN Community is awesome! Since posting in April about my frustration with PagerDuty and why I built All Quiet, I received many direct emails with feature requests or product roadmap questions. Out of this eager engagement we could integrate a bunch of cool new features: Since my post in April regarding my frustrations with PagerDuty and my rationale behind creating All Quiet, I've received many direct emails containing feature requests and questions about our product roadmap. Thanks to this awesome engagement, we've been able to integrate several fantastic new features: SMS & Voice Calls: ------------------ Initially, we weren't convinced that this would align with our product strategy. After all, why opt for SMS when there are push notifications? However, the demand for this feature was undeniable, so we went ahead and built it! https://bit.ly/3EpOA2m... Do Not Disturb Overrides: ------------------ We've rolled out a comprehensive guide for Android app users, ensuring they can seamlessly configure their DnD overrides. https://bit.ly/3EsNP8o... We're in the queue, awaiting Apple's green light for the "Critical Alert" entitlement. We've already coded the support for this in our iOS app. Schedules & Rotations: ------------------ This was a top request from the community — tools to manage rotations and schedules. We collaborated directly with teams that asked for this feature. The experience was genuinely collaborative, and we're immensely grateful to the teams that helped shape this functionality. https://bit.ly/3Em0ZUX... Login through Google & Microsoft: ------------------ Given that many teams use Google or Microsoft for authentication, it was only logical to incorporate these platforms as login providers. https://bit.ly/3P41WG9 September 3, 2023 at 09:26AM

Show HN: Cross-platform dotfiles manager written in Rust https://bit.ly/3qWERgC

Show HN: Cross-platform dotfiles manager written in Rust https://bit.ly/33UM8SR September 3, 2023 at 08:03AM

Show HN: A .bit gateway for resolving ipfs:// to https:// https://bit.ly/45Vtncg

Show HN: A .bit gateway for resolving ipfs:// to https:// bit.site dynamically captures all requests to *.bit.site, automatically resolving the IPFS/IPNS/Skynet content hashes for the corresponding .bit account records. It returns the relevant static content via HTTPS, enabling users to access decentralized networks with zero configuration on modern browsers. At the same time, we provide global CDN acceleration, striving to enhance the availability of decentralized content. https://bit.ly/3YYIxLv September 2, 2023 at 04:30PM

Show HN: Modular Diffusion – A modular Python library for diffusion models https://bit.ly/3Z3KqGX

Show HN: Modular Diffusion – A modular Python library for diffusion models Hello everyone! I've been working on this project for a few months as part of my thesis in Machine Learning. It's meant to be a library that provides an easy-to-use but flexible API to design and train Diffusion Models. I decided to make it because I wanted to quickly prototype a Diffusion Model but there were no good tools to do it with. I think it really can help people prototype their own Diffusion Models a lot faster and only in a few lines of code. The base idea is to have a Model class that takes different modules corresponding to the different aspects of the Diffusion Model process (noise schedule, noise type, denoising network, loss function, guidance, etc.) and allow the user to mix and match different modules to achieve different results. The library ships with a bunch of prebuilt modules and the plan is to add many more. I also made it super easy to implement your own modules, you just need to extend from one of the base classes available. Contrary to HuggingFace Diffusers, this library is focused on designing and training your own Diffusion Models rather than finetuning pretrained ones (although this is possible). I would really appreciate your feedback. https://bit.ly/45yDqUU September 2, 2023 at 03:16PM

Show HN: Mini VI mode update of Aih for talking to AI models in terminal https://bit.ly/3PnKj5E

Show HN: Mini VI mode update of Aih for talking to AI models in terminal Hi! We have a milestone update that introduces a mini VI mode for editing the inspirational quests to AI models by just type .v, then you have hjkl, wbyd... and :ai to send question, :q cancel it. As a thought2source tool, we believe that the next generation of user interface would be LUI which stands for Language User Interface. With this insight we think that VI mode is a wonderful tool for editing the representation of the profound thought--our languages's writing form besides the living voice. Enjoy and welcome feedback:) https://bit.ly/3QMlNfN September 2, 2023 at 04:32PM

Show HN: XRss: An RSS Reader and web stack demo powered by Htmx https://bit.ly/3EnZIwA

Show HN: XRss: An RSS Reader and web stack demo powered by Htmx XRss is a simple RSS reader web app built to showcase xtemplate, a new web development tool based on Go's html/template and Caddy server. The entire site UI for XRss comes from a single HTML template file . This index.html includes everything from SQL queries and route definitions and handlers to htmx state transition attributes and tailwindcss classes, and developing it requires zero build steps (amortized). Check out the source which manages to be at once banal and gnarly: https://bit.ly/3Z8zN5x... xtemplate preloads the whole template structure into memory and builds the router at startup, so responses to matching requests are rendered after a single lookup. Combined with direct queries to sqlite makes for a very snappy experience typically responding in less than 5ms. (Fingers crossed.) There are various places where XRss could be improved (PRs welcome!), but it already delivers on its purpose of demonstrating the plausibility of xtemplate. See the xtemplate readme for an overview of what you can do with it. I think of it as 'PHP but the syntax looks like Go templates'. https://bit.ly/45zZCho Let me know what you think! Does remaking PHP from scratch out of Go templates make me a lunatic? (yes) Is it a good idea anyway? (yes) What kind of web application do you think would be a good fit for a platform like this? https://bit.ly/3Z3CGEw September 2, 2023 at 04:02PM

Show HN: Nope Foundry, a FOSS framework for motion design, 2D compos and VFX https://bit.ly/3OXguYl

Show HN: Nope Foundry, a FOSS framework for motion design, 2D compos and VFX https://bit.ly/3OXgvvn September 1, 2023 at 11:06PM

Show HN: Backend for LLM coding copilots https://bit.ly/3EkFX8W

Show HN: Backend for LLM coding copilots https://bit.ly/45xeQU9 September 1, 2023 at 05:24PM

Show HN: esbuild-config − Config files for esbuild https://bit.ly/47ZJLu8

Show HN: esbuild-config − Config files for esbuild https://bit.ly/3Z1ShVl August 30, 2023 at 04:22PM

Show HN: I made an Open Source template based on BetaMax for your agency/studio https://bit.ly/3qYSGv9

Show HN: I made an Open Source template based on BetaMax for your agency/studio Hello everyone! I made a new Open Source landing page for agencies or studios and designed based on BetaMax. The site is built with Astro and Tailwind CSS The template is super simple and includes: - A landing page. You can see it live here: - https://bit.ly/3qOQaHV And grab the code and make it shine here: - https://bit.ly/3L7POTv *It's already submited to Astro's themes directory. Hope you guys like it and enjoy it. Take care! September 1, 2023 at 10:19AM