Home
Blog
Marcin Orliński

Author

Marcin Orliński

1
Articles
22 Jan 2025
First article

Areas of expertise

Data Engineering

Articles by Marcin Orliński

Data Engineering22 Jan

Optimizing Apache Spark

Speed up Apache Spark jobs with efficient file formats, smart partitioning, data skew fixes, caching, and careful use of UDFs. Practical tips for big data.

Marcin Orliński

PolandDS STREAM sp. z o.o.
Grochowska 306/308
03-840 Warsaw, Poland

United States of AmericaDS STREAM Corporation
1209 Orange St.
Wilmington, DE 19801

IndiaDATA SCIENCE & AI STREAM PRIVATE LIMITED
#07, K. No. 81/89/1, AVR Arcade, Kowdenahalli,
Ramamurthy Nagar Main Road,
Bengaluru 560016, Karnataka, India

REVIEWED ON5 / 5Clutch6 REVIEWS

Solutions

Cloud Solutions

Predictive Analysis

Sales Forecasting
Revenue Analytics
Promotion Analytics
Planogram
Performance Analytics
Loyalty Analytics
Hyperlocal Targeting
Customer Segmentation
Category Management Analysis
Business Intelligence Reporting

Intelligent Process Automation

Enterprise Workflow Automation
Data Ingestion
Category Management Platform
AI Productivity Assistant
AI Governance Tools
AI Agent Orchestration Platform
AI Omnichannel
VoIP AI Agents

Enterprise Data Management

Data Integration
Data Governance
Cloud Data
Cloud Migration

AI Engineering Platform

Services

Data Engineering

Data Lake Architecture
AI Data Quality
Data Pipeline Architecture
Real Time Data Processing
Software Engineering
Retail Data Integration
Data Warehouse Design
ETL Process Optimization

AI Engineering

Agentic AI Architecture
AI Productivity
Conversational AI Design
Custom Chatbot Development
Generative AI Development
Generative AI Governance
LLMOps
Shelf & Space Optimization Analytics
AI-Driven Assortment Optimization
Enterprise AI Factory

MLOps

AI Model Governance
Custom Machine Learning
Machine Learning Pipeline
ML Monitoring
MLOps Implementation

Data Science

AI Transformation

AI Transformation with Claude
Enterprise AI Transformation

Insights

Blog
Case Studies
Webinars

About Us

Who We Are
Careers
- India
- Global

AI Transformation with ClaudeTransformation programs built on Anthropic's Claude Enterprise AI TransformationStrategy-to-production change for large organizations

Cloud SolutionsArchitecture, migration and cost control Predictive AnalysisForecasting and revenue analytics Intelligent Process AutomationWorkflow automation with AI agents Enterprise Data ManagementGovernance, migration and cloud data AI Engineering PlatformBuild enterprise AI at scale

Sales ForecastingSKU-level forecasts that steer planning Revenue AnalyticsSee where revenue is made and lost Promotion AnalyticsWhich promos build margin, which burn it PlanogramPlan and verify shelf layouts Performance AnalyticsKPIs tracked from store to board Loyalty AnalyticsUnderstand and grow repeat buyers Hyperlocal TargetingDemand signals down to the neighborhood Customer SegmentationActionable segments from real behavior Category Management AnalysisCategory insights retailers trust Business Intelligence ReportingSelf-service reporting people actually use

Enterprise Workflow AutomationAutomate multi-step business processes Data IngestionAutomated intake from any source Category Management PlatformOne platform for category decisions AI Productivity AssistantAn assistant embedded in daily work AI Governance ToolsControl and visibility over AI usage AI Agent Orchestration PlatformCoordinate fleets of AI agents AI OmnichannelConsistent AI service on every channel VoIP AI AgentsVoice agents that handle real calls

Data IntegrationConnect systems into one data layer Data GovernanceOwnership, lineage and compliance Cloud DataModern data platforms in the cloud Cloud MigrationMove to cloud without breaking the business

Data EngineeringPipelines, platforms and decision-ready data AI EngineeringGenAI apps, copilots and agents in production MLOpsAutomation that keeps models reliable at scale Data ScienceForecasts, pricing and models that drive margin

Data Lake ArchitectureScalable lakes that keep raw data usable AI Data QualityAutomated checks that keep data trusted Data Pipeline ArchitectureRobust pipelines from source to decision Real Time Data ProcessingStreaming data with second-level latency Software EngineeringProduction-grade services around your data Retail Data IntegrationPOS, ERP and retail feeds in one model Data Warehouse DesignWarehouses built for analytics at scale ETL Process OptimizationFaster, cheaper and reliable data loads

Agentic AI ArchitectureMulti-agent systems designed for production AI ProductivityCopilots that speed up everyday work Conversational AI DesignDialogue flows users actually follow Custom Chatbot DevelopmentAssistants built on your data and tools Generative AI DevelopmentGenAI features shipped into your products Generative AI GovernanceGuardrails, evals and compliance for GenAI LLMOpsOperations for models, prompts and evals Shelf & Space Optimization AnalyticsImage-based shelf and space insights AI-Driven Assortment OptimizationAssortments tuned to store-level demand Enterprise AI FactoryA reusable platform that industrializes AI delivery

AI Model GovernanceVersioning, approvals and audit trails Custom Machine LearningModels built for your specific decisions Machine Learning PipelineRepeatable training and deployment flows ML MonitoringDrift and quality alerts in production MLOps ImplementationThe full MLOps stack, set up end to end

BlogEngineering insights from our delivery teams Case StudiesResults our clients can measure WebinarsLive sessions and recordings with our experts

Who We AreThe team behind ten years of AI in production CareersJoin engineers who ship AI that matters

IndiaFounding team of our Bengaluru hub GlobalRemote roles with an office in Warsaw

AI Transformation
Solutions
- Cloud Solutions
- Predictive Analysis
- Intelligent Process Automation
- Enterprise Data Management
- AI Engineering Platform
Services
Insights
About Us
- Who We Are
- Careers