The Innovation Dilemma: When Best Practices Get in the Way—and How to Move Forward
- JM Abrams
- Jun 7
- 2 min read
By J.M. Abrams, Chief Data Culturist — www.dataculturehivemind.com
Honoring Our Foundations While Reaching Forward
Best practices are often the unsung heroes of data-driven organizations — quietly supporting trust, scalability, and operational integrity. But what happens when those very practices, once born from innovation, begin to resist it?
This post examines how to evolve best practices in a manner that honors their purpose, respects the individuals who uphold them, and invites innovation into the fold.
⚖️ Best Practices: The Wisdom of Experience
Best practices aren't the problem. They are:
Collected wisdom from past successes and failures
Risk reducers that guard against costly mistakes
Foundational norms that support consistent, high-quality work
They build the trust infrastructure upon which innovation depends. Without them, chaos would ensue.
🚧 When Best Practices Begin to Inhibit Growth
The challenge arises not in their existence, but in their rigidity. Here are moments to watch for:
1. When Adherence Becomes Dogma
Practices become rigid doctrines, shutting out context or improvement.
Well-meaning teams may confuse “what’s familiar” with “what’s best.”
2. When They’re Not Reassessed
Practices are created in one era and applied uncritically in another.
What worked for batch ETL pipelines might not suit streaming architectures or real-time data needs.
3. When Innovation Requires Controlled Risk
Teams working on emerging technologies may feel boxed in by overly cautious governance.
The cost of compliance outweighs the cost of experimentation.
🌱 Cultivating Growth: Evolving Best Practices Mindfully
You’re not discarding best practices—you’re growing them.
🪴 Treat Best Practices as Living Systems
Frame them as versioned and adaptable, not final or sacred.
Regularly review their relevance and effectiveness.
Document why a practice exists, and allow room for exceptions or pilots.
🧑🤝🧑 Include Those Who Uphold Them
Invite the champions of current practices into conversations about evolution.
Recognize their deep knowledge and involve them in updating practices, not replacing them.
Change without inclusion feels like rejection. Change with inclusion feels like growth.
⚗️ Create Parallel Tracks
Allow dual paths: one for production-grade, governed practices; another for experimental or R&D workflows.
Over time, insights from innovation can inform new standards.
💬 Use Language that Builds Bridges
Say: “Let’s modernize this practice,” not “Let’s get rid of it.”
Emphasize continuity: “We’re building on what’s worked, not tearing it down.”
🐝 Hive Wisdom: Building a Culture of Evolving Excellence
In a strong data culture, best practices and innovation are not adversaries—they’re co-creators. Innovation without structure leads to chaos. Structure without innovation leads to stagnation.
But when you approach best practices as guiding principles that evolve through thoughtful collaboration, you foster a culture that is both grounded and forward-moving.
Just like a beehive adds new cells as the colony grows, your best practices should expand with your organization’s needs—never static, always alive.
Explore more on data culture and architectural clarity at Data Culture Hive Mind.
Disclaimer: The opinions expressed on this blog are solely those of the author and do not reflect the views, positions, or opinions of my employer.
LF05
Commenti