RL can be really difficult and frustrating. Feedback on “Modular RL” library I’m building?

⋅

RL sounds like a lot of fun from the outside. “AI for training robots to learn from experience”, sounds good. But when you dive in, it can be really frustrating and overwhelming to learn. Rather than being a single clear algorithm, there are many named algorithms: Actor Critic, A2C, PPO, DDPG, TD3, SAC etc.. it turns out that every named algorithm is the result of a research paper. But generally, these are not distinctive algorithms. For instance, if […]

Ver mais

Liked Liked
It’s Time to Build

It’s Time to Build

⋅

Credit: Brotha Stretch Goat It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on the side for about 13 years. Around the same time I started working on LearnGPT (which would eventually become […]

Ver mais

Liked Liked
WW-PGD: Projected Gradient Descent optimizer

WW-PGD: Projected Gradient Descent optimizer

⋅

Announcing: 𝗪𝗪-𝗣𝗚𝗗 — 𝗪𝗲𝗶𝗴𝗵𝘁𝗪𝗮𝘁𝗰𝗵𝗲𝗿 𝗣𝗿𝗼𝗷𝗲𝗰𝘁𝗲𝗱 𝗚𝗿𝗮𝗱𝗶𝗲𝗻𝘁 𝗗𝗲𝘀𝗰𝗲𝗻𝘁 I just released WW-PGD, a small PyTorch add-on that wraps standard optimizers (SGD, Adam, AdamW, etc.) and applies an epoch-boundary spectral projection using WeightWatcher diagnostics. Elevator pitch: WW-PGD explicitly nudges each layer toward the Exact Renormalization Group (ERG) critical manifold during training. 𝗧𝗵𝗲𝗼𝗿𝘆 𝗶𝗻 𝘀𝗵𝗼𝗿𝘁 • HTSR critical condition: α ≈ 2 • SETOL ERG condition: trace-log(λ) over the spectral tail = 0 WW-PGD makes these explicit optimization targets, rather than […]

Ver mais

Liked Liked
Google TV’s big Gemini update adds image and video generation, voice control for settings

Google TV’s big Gemini update adds image and video generation, voice control for settings

⋅

Soon, even loafing around on the couch won’t help you steer clear of AI. TV makers are busily integrating AI models into the experience, and Google is no different. At CES, the company announced a big expansion of Gemini features on the Google TV platform, starting with TCL smart TVs. Google began integrating Gemini with the TV Streamer box this past fall, but the new expansion brings some of the company’s most popular AI features to TVs: Nano […]

Ver mais

Liked Liked

3 best secure container images for modern applications

⋅

Modern software delivery depends on the reliability, integrity, and security of container images. As organisations migrate to microservices, automated CI/CD pipelines, and multi-cloud architectures, the container image becomes more than a packaging mechanism, it becomes a security boundary. A single vulnerability embedded in an image can replicate in clusters, environments, and deployments, creating widespread risk for applications that rely on speed and repeatability. Security-forward organisations are increasingly shifting from general-purpose base images to secure-by-design, minimal, or enterprise-maintained images […]

Ver mais

Liked Liked
4 Difference Between Edge Computing and Cloud Computing

4 Difference Between Edge Computing and Cloud Computing

⋅

Technology today is moving faster than ever. As India continues to digitalise, from smart cities to healthcare apps, people are often asking, “What’s the difference between edge computing and cloud computing?” This question matters not just for IT professionals but also for students, startups, and local communities adopting new tech for everyday problems. Let’s break it down together, shall we? What Describes the Relationship Between Edge Computing and Cloud Computing? Think of cloud computing in a nutshell as […]

Ver mais

Liked Liked

Advancing science and math with GPT-5.2

⋅

GPT-5.2 is OpenAI’s strongest model yet for math and science, setting new state-of-the-art results on benchmarks like GPQA Diamond and FrontierMath. This post shows how those gains translate into real research progress, including solving an open theoretical problem and generating reliable mathematical proofs.

Ver mais

Liked Liked

Focal-RegionFace: Generating Fine-Grained Multi-attribute Descriptions for Arbitrarily Selected Face Focal Regions

⋅

arXiv:2601.00156v1 Announce Type: new Abstract: In this paper, we introduce an underexplored problem in facial analysis: generating and recognizing multi-attribute natural language descriptions, containing facial action units (AUs), emotional states, and age estimation, for arbitrarily selected face regions (termed FaceFocalDesc). We argue that the system’s ability to focus on individual facial areas leads to better understanding and control. To achieve this capability, we construct a new multi-attribute description dataset for arbitrarily selected face regions, providing rich region-level annotations […]

Ver mais

Liked Liked
Helion Needs You

Helion Needs You

⋅

Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator. The goals of the company are quite ambitious—clean, continuous energy for 1 cent per kilowatt-hour, and the ability to manufacture enough power plants to satisfy the current electrical demand of earth in a ten year period. If both things happen, it will transform the world. […]

Ver mais

Liked Liked
EDA in Public (Part 1): Cleaning and Exploring Sales Data with Pandas

EDA in Public (Part 1): Cleaning and Exploring Sales Data with Pandas

⋅

Hey everyone! Welcome to the start of a major data journey that I’m calling “EDA in Public.” For those who know me, I believe the best way to learn anything is to tackle a real-world problem and share the entire messy process — including mistakes, victories, and everything in between. If you’ve been looking to level up […] The post EDA in Public (Part 1): Cleaning and Exploring Sales Data with Pandas appeared first on Towards Data Science.

Ver mais

Liked Liked

Load More

↑

Digitado © 2025