Sankara

<div class="ql-editor read-mode"><p><br></p><p><strong style="color: rgb(230, 110, 50); background-color: transparent;">REAL-TIME APPLICATIONS</strong></p><h1><strong style="color: rgb(22, 78, 133); background-color: transparent;">Building a Redis Cache from PostgreSQL Without Teaching Every Service to Dual-Write</strong></h1><p><span style="color: rgb(92, 107, 120); background-color: transparent;">An event-driven cache story using PostgreSQL change data, Kafka Connect and explicit replay semantics.</span></p><p><em style="color: rgb(21, 40, 61); background-color: transparent;">A product page needed single-digit-millisecond reads, but the source of truth remained PostgreSQL. The first proposal added a cache write beside every database transaction. It also added a new failure mode to every application path.</em></p><p><strong style="color: rgb(230, 110, 50); background-color: transparent;">Start with one workload | Scale into a complete platform | Open Source Freedom | Enterprise-Grade Operations.</strong></p><p><span style="color: rgb(21, 40, 61); background-color: transparent;">Published | August 2025</span></p><p><br></p><h2><strong style="color: rgb(22, 78, 133); background-color: transparent;">One customer journey, several systems</strong></h2><p><span style="color: rgb(21, 40, 61); background-color: transparent;">A product page needed single-digit-millisecond reads, but the source of truth remained PostgreSQL. The first proposal added a cache write beside every database transaction. It also added a new failure mode to every application path.</span></p><p><span style="color: rgb(21, 40, 61); background-color: transparent;">Dual writes make application code responsible for ordering, retries and repair. When one side succeeds and the other fails, the cache quietly becomes a second, weaker database.</span></p><table class="table table-bordered"><tbody><tr><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;"><em>The Cache Became A Projection, Not A Second Database.</em></strong></td></tr></tbody></table><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">The turning point</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The team projected committed PostgreSQL changes through CDC into Kafka and a managed sink. Redis keys became rebuildable views with explicit transformation, idempotency and lag signals.</span></p><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The team used OSS Manager to make CDC-driven cache projection with replay and reconciliation reviewable and repeatable. The engine still owned its native behaviour; the control plane made intent, prerequisites, execution and evidence visible to the people responsible for the service.</span></p><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">What had to become explicit</strong></h3><ul><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">The service boundary: Debezium captures approved PostgreSQL changes into Kafka. A managed Kafka Connect sink projects idempotent cache records into Redis, while PostgreSQL remains the system of record and a reconciliation job detects drift.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">The operational controls: publication scope, replication slot retention, schema contract, key design, idempotent sink, delete and TTL semantics, replay policy, DLQ, backpressure, and reconciliation.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">The capacity conversation: database change rate, event size, Kafka partitions, connector tasks, transformation cost, Redis working set and TTLs, replay burst, and recovery bandwidth.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">The human boundary: who may observe, who may approve, who may execute, and who decides whether the application is ready.<br></span></li></ul><h2><strong style="color: rgb(22, 78, 133); background-color: transparent;">The architecture that changed the conversation</strong></h2><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The diagram is deliberately centred on the decision the team had to make. It is not a product inventory. It shows where authority sits, what crosses the boundary, and where a failed assumption must stop the workflow.</span></p><p style="text-align: center;"><span style="color: rgb(21, 40, 61); background-color: transparent;"><img src="https://operate.hybrowlabs.com/files/kJH4QjL.png" height="454" width="888"></span><strong style="color: rgb(22, 78, 133); background-color: transparent;"><br></strong></p><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">The practical design choices</strong></h3><table class="table table-bordered"><tbody><tr><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Concern</strong></td><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Design answer</strong></td><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Operational signal</strong></td></tr><tr><td data-row="2"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Ordering</strong></td><td data-row="2"><span style="color: rgb(21, 40, 61); background-color: transparent;">Partition by stable business key</span></td><td data-row="2"><span style="color: rgb(21, 40, 61); background-color: transparent;">Source and sink lag</span></td></tr><tr><td data-row="3"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Duplicates</strong></td><td data-row="3"><span style="color: rgb(21, 40, 61); background-color: transparent;">Idempotent key upsert</span></td><td data-row="3"><span style="color: rgb(21, 40, 61); background-color: transparent;">Retry and DLQ rate</span></td></tr><tr><td data-row="4"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Repair</strong></td><td data-row="4"><span style="color: rgb(21, 40, 61); background-color: transparent;">Replay from durable log</span></td><td data-row="4"><span style="color: rgb(21, 40, 61); background-color: transparent;">Rebuild duration</span></td></tr><tr><td data-row="5"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Schema</strong></td><td data-row="5"><span style="color: rgb(21, 40, 61); background-color: transparent;">Version change events explicitly</span></td><td data-row="5"><span style="color: rgb(21, 40, 61); background-color: transparent;">Compatibility and sink rejection rate</span></td></tr><tr><td data-row="6"><strong style="color: rgb(21, 40, 61); background-color: transparent;">Freshness</strong></td><td data-row="6"><span style="color: rgb(21, 40, 61); background-color: transparent;">Measure source-to-cache delay</span></td><td data-row="6"><span style="color: rgb(21, 40, 61); background-color: transparent;">P95 projection age and serving latency</span></td></tr></tbody></table><p><span style="color: rgb(21, 40, 61); background-color: transparent;">These choices are intentionally small enough to review and test. They keep the architecture tied to operating behaviour instead of allowing a visually impressive diagram to hide unclear ownership.</span></p><h2><strong style="color: rgb(22, 78, 133); background-color: transparent;">What OSS Manager changed - and what it did not</strong></h2><p><span style="color: rgb(21, 40, 61); background-color: transparent;">OSS Manager brought discovery, planning, guarded execution and normalised status into one path for PostgreSQL, Kafka Connect, and Redis. It did not replace the engine's correctness model or the application's responsibility for data semantics.</span></p><ul><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">Before change, validate versions, hosts, identities, artifacts, topology and the recovery boundary without mutating the service.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">During change, persist progress, expose stop conditions and prevent a partial result from being mistaken for success.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">After change, observe PostgreSQL slot lag; Kafka consumer lag; connector task state; records and errors; DLQ volume; Redis latency and memory; cache freshness; reconciliation difference and run representative application journeys, not only process checks.</span></li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><span style="color: rgb(21, 40, 61); background-color: transparent;">For recovery, protect the last known-good authority and require an explicit decision before promotion, rollback or destructive cleanup.</span></li></ul><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">The failure modes worth rehearsing</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The test plan should make room for slot growth, schema-breaking change, duplicate event, out-of-order update, poisoned record, sink backpressure, Redis outage, stale cache, and replay storm. The purpose is not to produce a longer checklist. It is to learn whether operators can recognise the failure and choose the safe next action while the evidence is incomplete.</span></p><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">A human operating model</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">L1 operators need a plain-language answer to what is healthy, what is delayed and whether a change is in progress. Platform engineers need topology and evidence. Application owners need to know what users will experience. A useful platform connects those views without giving every person the same privileges.</span></p><table class="table table-bordered"><tbody><tr><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;"><em>The cache became easier to trust precisely because it was allowed to be disposable and reproducible.</em></strong></td></tr></tbody></table><h2><strong style="color: rgb(22, 78, 133); background-color: transparent;">Where this pattern earns its place</strong></h2><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">BFSI</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">This pattern is relevant where teams need controlled change, explicit authority, auditable recovery and customer-journey validation. The architecture must still be adjusted for local data classification, recovery objectives, workload shape and application behaviour.</span></p><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">Media and OTT</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">This pattern is relevant where teams need regional continuity, burst traffic, low-latency serving and predictable recovery. The architecture must still be adjusted for local data classification, recovery objectives, workload shape and application behaviour.</span></p><h3><strong style="color: rgb(22, 78, 133); background-color: transparent;">Retail</strong></h3><p><span style="color: rgb(21, 40, 61); background-color: transparent;">This pattern is relevant where teams need campaign peaks, catalogue freshness, transaction continuity and rapid rollback. The architecture must still be adjusted for local data classification, recovery objectives, workload shape and application behaviour.</span></p><h2><strong style="color: rgb(22, 78, 133); background-color: transparent;">The lesson we would carry into the next project</strong></h2><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The cache became easier to trust precisely because it was allowed to be disposable and reproducible.</span></p><p><span style="color: rgb(21, 40, 61); background-color: transparent;">The strongest open-source platforms are not the ones with the most automation. They are the ones where automation makes ownership, risk and recovery easier for people to understand.</span></p><table class="table table-bordered"><tbody><tr><td data-row="1"><strong style="color: rgb(21, 40, 61); background-color: transparent;"><em>Start with one workload. Prove the operating model. Then scale it into a complete platform.</em></strong></td></tr></tbody></table><p><br></p></div>

Explore PostgreSQL CDC, Kafka Connect and Redis caching with reliable replay, data reconciliation and clear operational ownership.

PostgreSQL CDC to Redis Cache | OSS Manager

building-a-redis-cache-from-postgresql-without-teaching-every-service-to-dual-write

Building a Redis Cache from PostgreSQL Without Teaching Every Service to Dual-Write

<div class="ql-editor read-mode"><p>Welcome to the second part of the ERPNEXT Developer Mastery series! In this article, we'll dive deeper into Python, one of the most versatile and widely used programming languages. Python is a must-know for any ERPNEXT developer, and in this installment, we'll explore Python functions, recursion, and more. Let's get started!</p><p><br></p><h2>Python Functions</h2><h3>What are Python Functions?</h3><p>Python functions are blocks of reusable code that perform a specific task. They are defined using the "def" keyword, followed by the function name, parameters enclosed in parentheses, and a colon. All code within the function is indented.</p><p>Example:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">def calculate_factorial(n):</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if n &lt; 2:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return 1</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return n * calculate_factorial(n - 1)</div></pre><p><br></p><h3>Another Example: Calculating Factorial of a Number Using Recursion</h3><p>One of the powerful features of Python functions is the ability to use recursion. Recursion is a technique where a function calls itself to solve a problem.</p><p><br></p><p>Recursive Function Logic:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">def calculate_factorial(n):</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if n &lt; 2:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return 1</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return n * calculate_factorial(n - 1)</div></pre><p><br></p><h3>Calling a Python Function</h3><p>Calling a Python function is straightforward. You simply use the function name followed by parentheses containing the required parameters.</p><p>Example:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">result = calculate_factorial(3) &nbsp;# Calling the function to calculate factorial of 3</div></pre><p><br></p><h3>Examples of Finding Factorials of Different Numbers</h3><p>Let's calculate the factorials of different numbers using our function:</p><p><br></p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">Factorial of 3:</div><div class="ql-code-block" data-language="plain">result = calculate_factorial(3) &nbsp;# Result: 6</div></pre><p><br></p><p><strong>Factorial of 10</strong>:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">result = calculate_factorial(10) &nbsp;# Result: 3628800</div></pre><p>Python functions are a fundamental building block of ERPNEXT development, allowing you to encapsulate logic and make your code more modular and maintainable.</p><p>In the next sections, we'll explore lambda functions, exception handling, list comprehension, and the map function to further enhance your Python skills as an ERPNEXT developer. Stay tuned for more Python heroics!</p><p><br></p><h2>Lambda Functions</h2><h3>Introduction to Lambda Functions</h3><p>Lambda functions, often referred to as anonymous functions, are concise, inline functions in Python. Unlike regular functions defined with the def keyword, lambda functions are defined using the lambda keyword. They are useful when you need a simple function without the need to define it separately.</p><p><br></p><p>Lambda functions have the following syntax:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">lambda arguments: expression</div></pre><p><br></p><h3>Example: Creating a Lambda Function to Double a Number</h3><p>Let's start by creating a lambda function to double a number. The lambda function will take a single argument (a number) and return its double. Here's the code:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">double = lambda x: x * 2</div></pre><p><br></p><h3>Demonstrating the Use of Lambda Functions</h3><p>Now that we have our lambda function, let's put it to work. We'll use it to double numbers and print the results.</p><p><br></p><ol><li data-list="ordered"><span class="ql-ui" contenteditable="false"></span><strong>Doubling Numbers Using Lambda Functions</strong></li></ol><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">double = lambda x: x * 2</div><div class="ql-code-block" data-language="plain">result1 = double(5)</div><div class="ql-code-block" data-language="plain">result2 = double(10)</div><div class="ql-code-block" data-language="plain">print(f"Double of 5: {result1}")</div><div class="ql-code-block" data-language="plain">print(f"Double of 10: {result2}")</div></pre><p>Output:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">Double of 5: 10</div><div class="ql-code-block" data-language="plain">Double of 10: 20</div></pre><p><br></p><p>Lambda functions are incredibly handy for simple operations like this. They save you from defining a full-fledged function when you need a quick, one-time calculation.</p><p><br></p><h2>Exception Handling</h2><h3>What is Exception Handling in Python?</h3><p>Exception handling is a crucial aspect of programming. It allows you to gracefully handle errors and unexpected situations in your code. In Python, exception handling is done using the try and except keywords.</p><p><br></p><h3>Handling Specific Exceptions</h3><p>Python allows you to catch specific exceptions and provide custom error messages when those exceptions occur. Here's how it's done:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Code that may raise an exception</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;a = 10 / 0</div><div class="ql-code-block" data-language="plain">except ZeroDivisionError:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Handle the ZeroDivisionError</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("Division by zero is not allowed.")</div></pre><p><br></p><h3>Handling Generic Exceptions</h3><p>Sometimes, you want to catch any error that occurs, regardless of its type. You can achieve this using a generic except block:</p><p>try:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Code that may raise an exception</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;a = 10 / 0</div><div class="ql-code-block" data-language="plain">except Exception as e:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Handle any exception and print the error message</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(f"An error occurred: {e}")</div></pre><p><br></p><h2>The "else" and "finally" Blocks in Exception Handling</h2><p>In addition to try and except, Python provides two more blocks for exception handling: else and finally.</p><p>The else block is executed if no exceptions are raised inside the try block.</p><p>The finally block is always executed, regardless of whether an exception occurred or not.</p><p><br></p><h3>Examples of Exception Handling</h3><p>Let's illustrate exception handling with two common scenarios: handling a NameError and handling a ZeroDivisionError.</p><p><strong>1. Handling a NameError</strong></p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Attempt to access an undefined variable</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(undefined_variable)</div><div class="ql-code-block" data-language="plain">except NameError:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Handle the NameError</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("The variable is not defined.")</div><div class="ql-code-block" data-language="plain">finally:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("Always executed.")</div></pre><p>Output:</p><p>The variable is not defined.</p><p>Always executed.</p><p><br></p><p><strong>2. Handling a ZeroDivisionError</strong></p><p>try:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Attempt to divide by zero</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;result = 10 / 0</div><div class="ql-code-block" data-language="plain">except ZeroDivisionError:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;# Handle the ZeroDivisionError</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("Division by zero is not allowed.")</div><div class="ql-code-block" data-language="plain">finally:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("Always executed.")</div></pre><p><br></p><p>Output:</p><p>Division by zero is not allowed.</p><p>Always executed.</p><p>Exception handling ensures that your program doesn't crash when errors occur and allows you to take appropriate actions based on the type of error.</p><p><br></p><h2>List Comprehension</h2><p><br></p><h3>What is List Comprehension?</h3><p>List comprehension is a concise and elegant way to create new lists by processing existing ones. It allows you to transform and filter data in a single line of code, making your code more readable and efficient.</p><p><strong>Example: Creating a new list of even numbers from an existing list</strong></p><p>Imagine you have a list of numbers from 1 to 10, and you want to extract only the even numbers into a new list. Here's how you can do it using list comprehension:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"># Original list</div><div class="ql-code-block" data-language="plain">original_list = [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]</div><div class="ql-code-block" data-language="plain"># List comprehension to extract even numbers</div><div class="ql-code-block" data-language="plain">even_numbers = [x for x in original_list if x % 2 == 0]</div></pre><p>Printing the Resulting List</p><p>Now, let's print the even_numbers list to see the result:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">print(even_numbers)</div></pre><p>The output will be:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">[2, 4, 6, 8, 10]</div></pre><p>List comprehension not only simplifies the code but also makes it more readable by clearly expressing the intent of the operation.</p><p><br></p><h2>Map Function</h2><h3>Introduction to Python's built-in "map" function</h3><p>The map function in Python is a versatile tool that applies a specified function to each item in an iterable (e.g., a list) and returns an iterable of the results. It's a concise way to transform data without the need for explicit loops.</p><p><br></p><p><strong>Example: Using the "map" function to calculate factorials</strong></p><p>Let's say you have a list of numbers, and you want to calculate the factorial of each number. Instead of writing a loop, you can use the map function:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"># Function to calculate factorial</div><div class="ql-code-block" data-language="plain">def factorial(n):</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if n &lt; 2:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return 1</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;return n * factorial(n - 1)</div></pre><p><br></p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"># List of numbers</div><div class="ql-code-block" data-language="plain">numbers = [1, 2, 3, 4, 5]</div></pre><p><br></p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain"># Using the map function to calculate factorials</div><div class="ql-code-block" data-language="plain">factorial_results = list(map(factorial, numbers))</div></pre><p>In this example, we define a factorial function to calculate the factorial of a number. Then, we use the map function to apply this function to each element in the numbers list.</p><p><br></p><p>Printing the Results</p><p>Now, let's print the factorial_results list to see the factorial values:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">print(factorial_results)</div></pre><p>The output will be:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">[1, 2, 6, 24, 120]</div></pre><p>The map function simplifies the code and separates the logic of calculating factorials from the iteration over the list.</p><p><br></p><h3>Conclusion</h3><p>In this part of the ERPNEXT Developer Mastery series, we've explored two powerful Python concepts: List Comprehension and the Map Function. These tools provide concise and efficient ways to manipulate data, making your code cleaner and more maintainable. List comprehension allows you to create new lists by filtering and transforming existing data, while the map function simplifies the process of applying a function to every element in an iterable.</p><p><br></p><p>By mastering these Python techniques, you're well on your way to becoming a Python hero in the world of ERPNEXT development. These skills will not only enhance your productivity but also improve the quality of your code, making you a more effective developer. Stay tuned for more exciting topics in our ERPNEXT Developer Mastery series, and don't forget to like and subscribe for updates. Happy coding!</p><p><br></p><h2>FAQ</h2><h3>1: What is ERPNEXT Developer Mastery Part 2 about?</h3><p>ERPNEXT Developer Mastery Part 2 is a continuation of our educational series focused on empowering developers with advanced Python skills and concepts that are invaluable in ERPNEXT development. In this part, we delve into List Comprehension and the Map Function, essential tools for enhancing your Python expertise.</p><p><br></p><h3>2: Why is List Comprehension important for ERPNEXT development?</h3><p>List Comprehension is crucial for ERPNEXT developers because it offers a concise and efficient way to manipulate data in Python. It allows you to create new lists by filtering and transforming existing data, making your code cleaner and more readable. This skill is essential for tasks like data processing and report generation in ERPNEXT.</p><p><br></p><h3>3: What is the Map Function, and how does it benefit ERPNEXT development?</h3><p>The Map Function is a built-in Python function that applies a specified function to each item in an iterable, such as a list. In ERPNEXT development, the Map Function simplifies data transformations and calculations. It allows you to apply a function to a collection of data without the need for explicit loops, making your code more efficient and maintainable.</p><p><br></p><h3>4: Can you provide an example of List Comprehension in ERPNEXT?</h3><p>Certainly! Let's say you want to extract a list of all active customers from a large dataset in ERPNEXT. You can use List Comprehension to filter the data efficiently and create a new list containing only active customer records. This reduces the complexity of your code and improves its readability.</p><p><br></p><h3>5: How can I practice and master List Comprehension and the Map Function for ERPNEXT development?</h3><p>To master List Comprehension and the Map Function, you can start by working on small Python projects that involve data manipulation. Additionally, online Python courses and tutorials offer hands-on exercises and examples. Stay engaged with the ERPNEXT Developer Mastery series to learn how to apply these skills specifically to ERPNEXT development scenarios. Practice and repetition are key to becoming proficient.</p></div>

We'll dive deeper into Python, one of the most versatile and widely used programming languages.

ERPNEXT Developer Mastery Part 2: Python Hero

erpnext-developer-mastery-part-2-python-hero

<div class="ql-editor read-mode"><p>This introduction will present an <a href="https://docs.erpnext.com/docs/v14/user/manual/en/introduction#:~:text=ERPNext%20is%20a%20full%2Dfeatured,remain%20ahead%20in%20the%20competition." rel="noopener noreferrer">overview of ERPNext</a> and its key components, highlighting its traffic framework and the benefits it offers to developers. Furthermore, it will delve into ERPNext's utilization of MariaDB assets database UJS, explaining how this combination enhances the development experience. The introduction will also mention the article's structure, starting with Python basics and gradually progressing into other aspects of market development.</p><p>ERPNext is a powerful framework that provides developers with a wide range of pre-built features required for typical software development. These features are designed to streamline the development process and enable developers to create efficient and robust applications. The subsequent sections will present these pre-built features in a concise and organized manner, listing the key functionalities that participants can expect to explore during the course.</p><p><br></p><h2>Overview of ERPNext and its Traffic Framework</h2><p>ERPNext is a well-established open-source <a href="https://en.wikipedia.org/wiki/Category:Python_(programming_language)_web_frameworks" rel="noopener noreferrer">Python-based framework</a> that serves as a versatile tool for developers. One of its notable components is the traffic framework, which allows developers to efficiently manage various aspects related to traffic and its management in applications. Through this framework, developers can implement traffic-related functionalities seamlessly, saving valuable development time and effort.</p><p><br></p><h2>ERPNext as an Open-Source Python-Based Framework</h2><p>ERPNext stands out as an open-source Python-based framework, making it accessible to a wide community of developers. Python's versatility as a programming language combined with ERPNext's open-source nature empowers developers to build customized and scalable applications without the burden of licensing costs. This aspect fosters collaboration and innovation within the developer community.</p><p><br></p><h2>Utilization of Maria DB Assets Database UJS</h2><p>ERPNext utilizes <a href="https://en.wikipedia.org/wiki/MariaDB" rel="noopener noreferrer">MariaDB </a>assets database UJS as the underlying database system. The utilization of MariaDB ensures data integrity, high performance, and reliability in the developed applications. The combination of ERPNext with MariaDB assets database UJS enables seamless handling of data and efficient database management.</p><p><br></p><h2>Pre-built Features for Software Development</h2><p>During the course, participants will benefit from various pre-built features integrated into ERPNext, which are specifically designed to support software development. These features include:</p><ol><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><strong>Dynamic Typing with Python Variables:</strong> <a href="https://wiki.python.org/moin/Why%20is%20Python%20a%20dynamic%20language%20and%20also%20a%20strongly%20typed%20language" rel="noopener noreferrer">Python's dynamic typin</a>g allows developers to assign different data types to variables during runtime, making it a flexible and efficient language for coding.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><strong>Data Types</strong>: Python supports various data types, such as integers, strings, dictionaries, and floats, enabling developers to work with diverse data structures effectively.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><strong>Dictionaries:</strong> ERPNext introduces students to dictionaries, which are essential data structures in Python. Dictionaries store key-value pairs and facilitate easy access to values based on keys.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><strong>Control Flows: </strong>The course covers essential control flow statements in Python, including if-else and elif, which enable developers to execute specific code blocks based on certain conditions.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span><strong>Loops: </strong>Participants will learn about the two types of loops in Python: for loops and while loops. These loops allow efficient iteration over a range of values and repetitive execution of code until certain conditions are met.</li></ol><p><br></p><h2>II. Python Basics for ERPNext Development</h2><h3>A. Understanding Variables in Python</h3><p>Python's dynamic data typing allows flexibility in variable assignments. Variables can hold different data types, and their types can change during execution. For example:</p><ol><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Dynamic Data Typing in Python: Python allows variables to change their data types on the fly. For instance, a variable can hold an integer value at one point and a string value at another.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Examples of Integer and String Variables: Let's explore examples of how to use integer and string variables in Python with code snippets.</li></ol><p><strong>Integer Variables:</strong></p><p><img src="/files/pUDEkCU.png" width="369"></p><p><strong>String Variables:</strong></p><p><img src="/files/AFjuHUX.png" width="377"></p><h3>B. Exploring Data Types in Python</h3><p>Python supports various data types, each serving different purposes. Understanding these types is essential for <a href="https://hybrowlabs.com/erpnext-development-services#:~:text=Hybrowlabs%20ERPNext%20development%20services%20include,%26%20manage%20tasks%20anytime%2C%20anywhere." rel="noopener noreferrer">ERPNext development</a>. The main data types in Python are:</p><ol><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>integers: Integers are whole numbers and can be positive, negative, or zero. They are commonly used for counting and indexing.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Floats: Floats represent decimal numbers and are used for more precise calculations that require fractional values.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Strings: Strings are sequences of characters and are extensively used for text handling and manipulation.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Dictionaries: Dictionaries are key-value pairs, allowing efficient data retrieval using unique keys.</li></ol><h3>C. Accessing Values from Dictionaries</h3><p>Dictionaries are powerful data structures in Python that enable efficient data organization and retrieval. To access values from dictionaries, we can use the keys associated with each value:</p><ol><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Using Keys to Retrieve Values: We can access dictionary values by providing their corresponding keys. This method allows quick and direct access to specific data elements.</li><li data-list="bullet"><span class="ql-ui" contenteditable="false"></span>Providing Default Values for Non-Existing Keys: In cases where the specified key is not present in the dictionary, we can define default values to handle such situations gracefully.</li></ol><p><br></p><h2>III. Control Flows in Python</h2><h3>A. Conditional Statements in Python</h3><p>Python provides several conditional statements to control the flow of a program based on certain conditions. Let's explore some of them:</p><p><strong>1. if-else Statement:</strong></p><p>The if-else statement allows us to execute one block of code when a condition is true and another block of code when the condition is false. Here's an example:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">a = 5</div><div class="ql-code-block" data-language="plain">b = 10</div><div class="ql-code-block" data-language="plain">if a &gt; b:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("a is greater than b")</div><div class="ql-code-block" data-language="plain">else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("b is greater than a")</div></pre><p><br></p><p><strong>2. elif Statement:</strong></p><p>The elif statement stands for "else if" and is used when you have multiple conditions to check. It allows you to test multiple conditions and execute the corresponding block of code of the first true condition. Example:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">x = 15</div><div class="ql-code-block" data-language="plain">if x &lt; 10:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("x is less than 10")</div><div class="ql-code-block" data-language="plain">elif x == 10:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("x is equal to 10")</div><div class="ql-code-block" data-language="plain">else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("x is greater than 10")</div></pre><p><br></p><p><strong>3. Nested if-else Statements:</strong></p><p>You can also nest if-else statements within each other to create more complex conditions. Here's an example of a nested IF-ELSE statement:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">num = 20</div><div class="ql-code-block" data-language="plain">if num &gt; 10:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if num % 2 == 0:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;print("num is greater than 10 and even")</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;print("num is greater than 10 but odd")</div><div class="ql-code-block" data-language="plain">else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("num is less than or equal to 10")</div></pre><p><br></p><h3>B. Implementing Conditional Flows for ERPNext Development</h3><p>In ERPNext development, you can use conditional statements to control the flow of your code based on specific requirements. Here are some practical examples:</p><p>1. Finding the Greatest of Three Numbers:</p><p>In ERPNext, you might come across scenarios where you need to find the greatest number among three given values. Here's how you can implement it:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">a = 5</div><div class="ql-code-block" data-language="plain">b = 10</div><div class="ql-code-block" data-language="plain">c = 20</div><div class="ql-code-block" data-language="plain"><br></div><div class="ql-code-block" data-language="plain">if a &gt; b and a &gt; c:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("a is the greatest number.")</div><div class="ql-code-block" data-language="plain">elif b &gt; a and b &gt; c:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("b is the greatest number.")</div><div class="ql-code-block" data-language="plain">else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print("c is the greatest number.")</div></pre><p><img src="/files/YpDArve.png" width="393"></p><p>2. Utilizing Indentation in Python:</p><p>Python uses indentation to define blocks of code. In ERPNext development, it's essential to use proper indentation to maintain the code's structure and readability. Here's an example of how indentation is used:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">def calculate_total(price, quantity):</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if quantity &gt; 0:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;total = price * quantity</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;print(f"The total cost is: {total}")</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;else:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;print("Quantity must be greater than zero.")</div></pre><p>In this example, the code inside the function is indented to define the block of code that belongs to the function.</p><p>Control flows in Python, including conditional statements and loops, are powerful tools that allow developers to make decisions and execute specific actions based on different conditions. By mastering these concepts, you can effectively implement various functionalities in your ERPNext development projects.</p><p><br></p><h2>IV. Loops in Python</h2><p>Python offers powerful looping mechanisms that allow developers to execute code repeatedly. Let's explore two types of loops: for loops and while loops.</p><h3>A. For Loops</h3><p>For loops are commonly used when you need to iterate over a sequence of elements a specific number of times.</p><p>1. Utilizing the Range Function</p><p>The range() function generates a sequence of numbers that can be used for iteration. Here's an example of a for loop using the range() function to print numbers from 1 to 10:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">for i in range(1, 11):</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(i)</div></pre><p><img src="/files/jSwxCSZ.png" width="392"></p><p>2. Iterating through Lists using For Loop</p><p>For loops are also useful for iterating through lists and performing operations on each element. Consider the following example of printing each item in a list:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">fruits = ['apple', 'banana', 'orange']</div><div class="ql-code-block" data-language="plain">for fruit in fruits:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(fruit)</div></pre><p><br></p><h3>B. While Loops</h3><p>While loops are used when you want to repeat an operation as long as a specified condition is true.</p><p>1. Basics of While Loop</p><p>The while loop executes a block of code repeatedly until the given condition becomes false. Here's a basic example of a while loop printing the first 10 integers:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">i = 1</div><div class="ql-code-block" data-language="plain">while i == 10:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(i)</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;i= i+ 1</div></pre><p><img src="/files/lwzMCii.png" width="406"></p><p>2. Controlling Loops with Conditions</p><p>You can control the flow of a while loop using conditional statements. Here's an example of using a while loop to print even numbers:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">num = 2</div><div class="ql-code-block" data-language="plain">while num &lt;= 10:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(num)</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;num += 2</div></pre><p>3. Difference between For and While Loops</p><p>For loops are ideal when you know the number of iterations in advance, whereas while loops are useful when the number of iterations depends on a condition. Understanding the differences between them is crucial for efficient coding.</p><p><br></p><h3>C. Looping for ERPNext Development</h3><p>In the context of ERPNext development, loops can be beneficial for repetitive tasks and data processing.</p><p>1. Printing the First 10 Integers</p><p>Looping is essential for various ERPNext development tasks. For instance, you might need to print the first 10 integers as shown earlier.</p><p>2. Break Statements for Loop Termination</p><p>Break statements can be used to prematurely terminate a loop when a specific condition is met. Let's consider a scenario where we want to exit a loop once a certain condition is satisfied:</p><pre class="ql-code-block-container" spellcheck="false"><div class="ql-code-block" data-language="plain">i = 1</div><div class="ql-code-block" data-language="plain">while True:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;if i == 5:</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp; &nbsp; &nbsp;break</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;print(i)</div><div class="ql-code-block" data-language="plain"> &nbsp; &nbsp;i += 1</div></pre><p>Understanding loops in Python is crucial for mastering ERPNext development and other software-related tasks. By leveraging for loops and while loops effectively, you can efficiently process data and perform repetitive operations.</p><h2>V. Conclusion</h2><p>In conclusion, the ERPNext Developer Mastery Part 1: Python Hero provides a solid foundation for <a href="https://hybrowlabs.com/blog/maximizing-your-roi-with-erpnext-development-services" rel="noopener noreferrer">ERPNext development</a> using Python. The course covers essential Python fundamentals, including dynamic typing and various data types such as integers, strings, and dictionaries. Participants have gained an understanding of control flows through if-else and elif statements, as well as the usage of for and while loops for iterative processes. With this knowledge, learners are now well-prepared to delve into more advanced ERPNext development topics in Part 2 of the article. By mastering these fundamental Python concepts, participants are equipped with the necessary skills to confidently tackle complex ERPNext development tasks.</p><h2>FAQ</h2><h3>1. What is ERPNEXT, and why is it relevant for Python developers?</h3><p>ERPNEXT is an open-source Python-based framework that utilizes MariaDB as its database. It provides a powerful toolset for building robust software applications. Python developers find ERPNEXT relevant as it offers a comprehensive ecosystem and pre-built features, making it ideal for developing efficient ERPNext solutions.</p><h3>2. What are the main Python fundamentals covered in Part 1 of the article?</h3><p>Part 1 of the article focuses on essential Python fundamentals. It starts with dynamic typing, where participants learn how Python allows variables to change data types during runtime. The course also covers fundamental data types like integers, strings, and dictionaries, providing a strong foundation for ERPNext development.</p><h3>3. How does Python handle conditional execution in ERPNEXT development?</h3><p>Python's control flow mechanisms are essential for making decisions in ERPNext development. Participants learn about if-else statements and the use of elif (else if) for handling multiple conditions. Understanding these control flows is crucial for developing logic and making decisions based on different scenarios.</p><h3>4. What is the significance of loops in Python programming for ERPNext applications?</h3><p>Loops play a vital role in ERPNext development as they enable the execution of repetitive tasks efficiently. The course covers for loops, which iterate through a specified range or list of objects, and while loops, which execute based on a given condition. Mastering these loop structures is crucial for optimizing processes in ERPNext development.</p></div>

This introduction will present an overview of ERPNext and its python components, highlighting its traffic framework and the benefits.