🦞🌯 Lobster Roll

Thread

Parallel computation in Python with Dask (opensource.com)

Stories related to "Parallel computation in Python with Dask" across the full archive.

Parallel computation in Python with Dask (opensource.com)
Extreme IO performance with parallel Apache Parquet in Python (wesmckinney.com)
Parallel Programming in Python (sebastianraschka.com)
Ufora - A compiled, automatically parallel subset of python for data science and numerical computing (ufora.github.io)
Quick Tip: Speed up your Python data processing scripts with Process Pools (medium.com)
Reducing Python's startup time (lwn.net)
Python’s Weak Performance Matters (metarabbit.wordpress.com)
Memory efficiency of parallel IO operations in Python (code.kiwi.com)
Incrementally improving the performance of a python script (mycode.doesnot.run)
Python startup time: milliseconds matter (mail.python.org)
Python vs NumPy vs Nim (narimiran.github.io)
Optimizing a Python application with C++ code (antlarr.io)
Lazy Interfaces in Python (github.com)
I've been toying with the idea of lazy execution and wrote a small library to play with the concept. I personally find the paradigm quite powerful and would like to hear some thoughts from you all about it.
Porting Synapse to Python 3 (matrix.org)
Matrix.org's reference implementation (Synapse) is now compatible with python 3. This talks about their reason for porting, performance gains, and how their code is still compatible with python 2.
What I've Learned About Optimizing Python (gregoryszorc.com)
An overview of performance issues with Python and how to work around them.
High-Performance in Python with Zero-Copy and the Buffer Protocol (julien.danjou.info)
The CPython Bytecode Compiler is Dumb (nullprogram.com)
Choosing a faster JSON library for Python (pythonspeed.com)
Write faster C extensions for Python with Cython (opensource.com)
Fastest Way to Load Data Into PostgreSQL Using Python (hakibenita.com)
Austin: Python frame stack sampler for CPython (github.com)
Not just CPU: writing custom profilers for Python (pythonspeed.com)
Interview with Dask’s creator: Scale your Python from one computer to a thousand (notamonadtutorial.com)
Our journey to type checking 4 million lines of Python (blogs.dropbox.com)
MicroSpec: Speculation-Centric Fine-Grained Parallelization for FSM Computations (2016) (cs.wm.edu)
Abstract: "Finite state machines (FSMs) are basic computation models that play essential roles in many applications. Enabling efficient parallel FSM execution is critical to the performance of these applications. However, they are very challenging to parallelize due to their inherent data depende...
Easy Concurrency in Python (pljung.de)
How We Spotted and Fixed a Performance Degradation in Our Python Code (blog.redash.io)
This links to our blog, but I actually submitted a link to dev.to: https://dev.to/redash/how-we-spotted-and-fixed-a-performance-degradation-in-our-python-code-4g5l, because you can comment there.
Make Vim Python plugin 10x faster using Rust (liuchengxu.org)
cachew: persistent cache/serialization powered by Python type hints (github.com)
Scalene: a high-performance CPU and memory profiler for Python (github.com)