Learn the basics of command-line arguments in Bash so that you make the most of shell scripts in your work as a data scientist. — Let’s learn a little bit of shell scripting, as it will greatly improve your ability to supply and parse command-line arguments (CLA) to your Python scripts. A shell script is a computer program designed to be run by the Unix shell, a command-line interpreter. Typical operations performed by shell scripts…

Avoid these common bad practices and rookie mistakes — Do you recognize yourself in any of the seven statements below? Then this story is for you! You’re using sys or os for file path management You’re formatting strings with .format() or the % operator You’re not using typing type-hints You’re not using explicit Pandas functionalities with lambda You’re printing…

Create beautiful Python documentation in MkDocs & Material with these five automation steps and pre-commit Git hooks — In this story, you will learn how to automatically generate documentation from Python modules with a bit of magic in our custom functions, the package mkgendocs, pre-commit Git hooks, and MkDocs. We will touch upon the following elements MkDocs & Material installation Automate type-hints to docstrings

Automatically insert variables types from Python’s type-hints (3.5+) into Google-style docstrings — In this story, you will follow me along a journey to automatically generate Google-style docstrings from Python type-hints. We will be looking at the following elements. Python type-hints Insert type-hints into function docstrings Automation with pre-commit Git hooks Python Type-hints Since Python 3.5+, we’ve seen the next generation of code documentation: hinting…

Use pre-commit Git hooks to automate Python code style with these linting and formatting tools — Do you dream of never having to worry about formatting your Python code? In this article, I will share with you how to automate clean coding principles. Linting your code with flake8, isort, and mypy. Formatting your code with black. Pre-commit Git hooks Automating Git formatter hooks in place. Linting Your Code

How to use, format, and fade “flash” messages in Django, both with page reload and asynchronous JavaScript submission — In this article, you will learn how the Django messages framework works and how you can use its power, including a way to fade the messages when submitting forms via JavaScript without reloading the page.

Here are the seven tips and code bites that I use every day in my work as a data scientist. — In this story, I will share what I use in my day-to-day work and what has helped me improve my code. Check the list below to see if there’s anything new for you! String formatting with f-strings Platform independent directory delimiters Variable unpacking and the _ operator .get instead of…

Learn about distributed task queues for making asynchronous API requests — What happens when a user sends a request, but processing that request takes longer than the HTTP request-response cycle? What if you’re accessing multiple databases or want to return a document too large to process within the time window? …

How to incorporate the immensely popular JSON data format in Python for storage of textual data. — In this story, we’ll look at JavaScript Object Notation or JSON, probably the world’s preferred data-interchange format and a sure-fire upgrade from more traditional file storage options (XML, CSV, TSV). We’ll cover the basics for creating and loading JSON files, file storage, and newline delimited JSON storage and take a…