posted: 2023-02-05 12:26:28
How to choose between Pandas and Polars for python data projects.
Pandas and NumPy have long been the open source dynamic duo of python data science.
They provide flexible data structures that can handle a wide range of data types including tabular data, time series data, and more.
They also provide a wide range of data analysis, data cleaning, data transformation, data aggregation, and data visualization tools.
And while they generally provide a performance boost over pure python implementations, they are still single threaded and so cannot take advantage of even moderately contemporary hardware.
This is being addressed by the Polars project which is a rust-based python library that leverages Apache Arrow and parallel procesing on multicore CPUs.
The best description Ive found for this comes from here or, if you like videos, Ritchie Vink explains it well Tell me why. [ 1 remarks ]
HackerMojo.com is using a fluid layout based upon work by Dave Reeder. I'm trying to take CSS a little more seriously; but I'm having a hard time because of all of the bad syntax, browser compatibility hacks, and non-fluid layouts. If any of the other technology I used were like CSS, I'd have to set myself on fire and jump off of a cliff.
* denotes django powered sites.
posted: 2023-02-05 11:36:05
Delta tables and Iceberg are both technologies that enable big data management on distributed systems such as Apache Spark, but there are several key differences between the two.
* denotes sites I'm associated with.
posted: 2023-02-05 11:30:46
This is the simplest recipe for getting started with a medallion style delta lake with Databricks.
The steps/commands can be summarized as:
posted: 2012-09-03 12:51:44
As part of a corporate fitness program I received a fitbit. It loved it so much that I bought a second one for my wife. Then, one day, it happened. I lost my fitbit.
Read More [ 1416 remarks ]
posted: 2012-09-03 11:48:58
What made me look at this blog for the first time in quite a while was hearing my wife talk about changes to the comment system on gawker. When I looked at my own blog spam, I saw something interesting...
Read More [ 2619 remarks ]
posted: 2012-09-03 11:00:37
Man, it has been about 2 years since I gave this blog any love. Clearly it needs to be updated. Maybe during some upcoming vacation time it. The real reasons that this bog has died:
Read More [ 674 remarks ]
posted: 2010-03-22 14:18:29
You need DropBox and I need some extra dropbox space. If you use this link then we both win and we both get free extra space! You know what to do.
Leave a Comment [ 842 remarks ]
posted: 2009-10-03 13:09:00
Zoe Rose Franxman was born three weeks ago on September 14. She was 10 lbs, 4 oz. and 21 inches long!
Read More [ 948 remarks ]
posted: 2009-06-08 20:40:49
This weekend I finally made it down to Destination Motorcycles. I got to sit on a few bikes and talk to the owner. I have a little more respect for the Ducati Multistrada now that I've been on one. But the real reason that I was there was to sit ...
Leave a Comment [ 502 remarks ]
There are 284 entries like these. Check 'em out
hosting: slicehost.com.
powered by: django.
written in: python.
controlled by: bzr.
monsters by: monsterID.