Search for:
The Baseline Datastack – Going Beyond The Modern Data Stack


Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being funded. So that means every company has…
Read more

The post The Baseline Datastack – Going Beyond The Modern Data Stack appeared first on Seattle Data Guy.


Read More
Author: research@theseattledataguy.com

The history of Machine Learning


You’d be forgiven for assuming that the history of machine learning, artificial intelligence and smart computers is all very recent. When we think of these technologies, we tend to imagine something very contemporary, something that has only been developed in the last decade. But you might be surprised to know that the history of machine […]

The post The history of Machine Learning appeared first on LightsOnData.


Read More
Author: George Firican

4 Reasons Data Scientists Leave (and How to Retain Top Talent)


The demand for Data Science talent far exceeds the talent pool, making employee retention challenging. Demand is expected to remain high throughout 2022, providing ample opportunity for talent to move upwards through competing organizations. A vast amount of project familiarity and understanding is built on the backs of data scientists and is lost when they […]

The post 4 Reasons Data Scientists Leave (and How to Retain Top Talent) appeared first on DATAVERSITY.


Read More
Author: David Van Bruwaene

What to Expect from AI in 2022


These past two years have ushered in major changes to how we navigate work, human interactions, and information. These shifts have coincided with the increased maturity of AI as a field. As AI has become more widespread, accessible, and acceptable, it’s stepped in to fill gaps in the economic, social, institutional, and political realms – […]

The post What to Expect from AI in 2022 appeared first on DATAVERSITY.


Read More
Author: Paul Barba and Mehul Nagrani

Engineered Decision Intelligence: The Best Way Forward Part 1
featured-image

Part 1: You Need a Data Fabric

Among Gartner’s top 10 data and analytics trends for 2021 is engineered decision intelligence.[1] That raises two compelling questions: What is this? and Why should you care?

Engineered business intelligence is, when you think about it, just what it says: a deliberate process to deriving business intelligence from data. The why of it is also straightforward: Businesses need to make informed decisions as a situation is unfolding. After the fact is usually too late. Too many decision-making outcomes are unsuccessful because complex ecosystems of data in motion make it hard to assemble data in a timely and contextually relevant manner. That’s the problem that engineered decision intelligence is trying to overcome.

But there’s an even more fundamental problem to overcome first. Right now there’s a huge arsenal of decision intelligence tools one can use—from basic query and reporting to analytics and advanced artificial intelligence and adaptive system applications. However, the insights these provide are only as good as the data that powers them. According to Gartner, that means engineered decision intelligence is about pairing these tools with a common data fabric and composability support—which enables the use of components from multiple data, analytics, and AI solutions—thus paving the way for decisions that are more accurate, repeatable, and traceable. To these benefits, I would add “timely,” because you need real-time decision-making capabilities in order to assess and share information as soon as it’s collected.

Let’s start by looking at why the data fabric is essential for engineered decision intelligence. I’ll be sharing insights on composability support and how to achieve it in a subsequent post.

What is a Data Fabric?

A data fabric is an architecture that provides a consistent set of data services and capabilities across your critical on-premises and cloud environments. It acts as a foundation that enables you to abstract data from systems that are physically and logically distinct to create a common set of data objects that you can treat as a unified enterprise data set.

Why Do I Need a Data Fabric for Engineered Decision Intelligence?

Because engineered decision intelligence needs to work with data from systems that may be on-premises, in the cloud, spread across multiple clouds, and even deployed remotely at the network’s edge, the data fabric provides a way to weave these sources into a network of information to power your decision intelligence tools.

By utilizing a data fabric, you can realize the full potential of your decision intelligence tools. Since they can access data across the enterprise faster and more efficiently, you’ll gain more integrated and accurate business insights and increased business agility. And, as decisions become more operationalized and standardized by the data fabric, they become more repeatable and traceable. Plus, as decision intelligence tools are able to execute more iterations on new data exposed by the data fabric, they can learn from previous outcomes to produce more reliable and repeatable results.

Avalanche: The Foundation of a Modern Data Fabric

The Actian Avalanche™ hybrid-cloud data warehouse, integration, and management platform provides the critical capabilities you need to implement a modern data fabric and unlock the value of your data for engineered decision intelligence. This is roughly a three-step process involving integration services built into Avalanche:

  • The first step is to build a metadata catalog of contextual information about the data you intend to access—such as where the data came from, how the data is defined, and when it was last updated. Metadata makes the data more easily searchable and provides insight into the data profiles used in decision intelligence.
  • Avalanche then uses the metadata catalog to create a knowledge graph. This provides a semantic layer that represents each entity (things such as person, location, organization, product, etc.) and its relationships with other entities. Avalanche uses artificial intelligence and machine learning to enrich the metadata, which further enhances data interpretation and contextualization. This helps users get more relevant and faster query responses. The knowledge graph also makes it possible to view the data from multiple dimensions and to access the data using a variety of decision intelligence tools—without modifying the source data on the underlying systems.
  • Lastly, the integration services in Avalanche use the knowledge graph to bring together the requisite enterprise data sources and reconcile them into a common data set. Avalanche integration services connect with Google Cloud Storage, Amazon S3, and Azure Data Lake Storage—as well as more than 200 applications, web-service APIs, JSON data, and even spreadsheets. Once your data sources are integrated, the data fabric drives data flow orchestration and automation to deliver information to users and decision intelligence tools.

That’s a Wrap!

This is just a brief overview of the role a modern data fabric plays in the delivery of engineered decision intelligence. One of the key takeaways, here, is that a data fabric really matters in real-time decision-making use cases. If you want more insight into how Actian Avalanche can provide the data fabric functionality I’ve been talking about, you should read the three-part blog series by my colleague Lewis Carr, where he looks at the impact of Covid-19 on the retail industry and showcases how a modern data fabric can improve support for decision-makers. You’ll find that story here.

[1] https://www.gartner.com/smarterwithgartner/gartner-top-10-data-and-analytics-trends-for-2021/

 

This article was originally published on The New Stack.

This article was co-authored by Lewis Carr.

Lewis Carr co-author of article on Decision Intelligence

Senior strategic vertical industries, horizontal solutions, product marketing, product management, and business development professional focused on Enterprise software, including Data Management and Analytics, Mobile and IoT, and distributed Cloud computing.

The post Engineered Decision Intelligence: The Best Way Forward Part 1 appeared first on Actian.


Read More
Author: Teresa Wingfield

For Cloud Adopters, Data Privacy Day Is an Occasion for Both Hesitancy and Hope


Data Privacy Day is an occasion that brings decidedly mixed emotions for those who rely on the cloud to do business. On the one hand, it’s a day to celebrate the importance of data privacy and the very real advances that have been made by enterprises to ensure it. On the other hand, it’s a […]

The post For Cloud Adopters, Data Privacy Day Is an Occasion for Both Hesitancy and Hope appeared first on DATAVERSITY.


Read More
Author: Keith Neilson

2022: The Year Automation Comes to the Forefront of Reliability and Experience


It’s no shock to anyone that 2021 was a year of big change, much of it due to the continued effects the global pandemic has on how we do business. As every organization across every industry addresses their new needs for digital transformation and continues to expand distributed working options for their employees, it’s clear the way […]

The post 2022: The Year Automation Comes to the Forefront of Reliability and Experience appeared first on DATAVERSITY.


Read More
Author: Julian Dunn

What Can Enterprise IT Leaders Expect in 2022?


The past two years of remote work have been both a sprint and a marathon for IT leaders – working to find quick solutions to keep the lights on and businesses running remotely, coupled with making remote work scalable, sustainable, and secure long-term. During this time, IT leaders’ mindset around digital transformation shifted from being […]

The post What Can Enterprise IT Leaders Expect in 2022? appeared first on DATAVERSITY.


Read More
Author: Jesse Stockall

How AI Can Transform Hybrid Events


The initial phase of the global pandemic shocked nearly every industry, with in-person events effectively grinding to a halt. Industry conferences that millions of people had relied on for networking, training, and generating business were suddenly gone. Fortunately, companies, organizers, and supporting event platforms were agile, quick-footed, and resourceful in their efforts to shift events […]

The post How AI Can Transform Hybrid Events appeared first on DATAVERSITY.


Read More
Author: Humphrey Chen

Still Not Convinced About Data Storytelling? Read This


Data on how organizations operate can inform how they make decisions across the board, no matter their size.  Gartner’s Data & Analytics Trends Report for 2021 included the use of “data and analytics as a core business function,” while IDC suggests that almost two-thirds (64%) of businesses believe data collection and analysis has “fundamentally changed the way […]

The post Still Not Convinced About Data Storytelling? Read This appeared first on DATAVERSITY.


Read More
Author: Peter Jackson

Five Data Governance Trends for Organizational Transformation in 2022


The importance of data has increased multifold as we step into 2022, with an emphasis on active Data Management and Data Governance. Furthermore, thanks to the introduction of new technology and tools, we are now able to automate labor-intensive data and privacy operations. Below are five Data Governance trends organizations can adopt based on digital […]

The post Five Data Governance Trends for Organizational Transformation in 2022 appeared first on DATAVERSITY.


Read More
Author: Tejasvi Addagada

Why Zero Trust and XDR Are the Future of Data Security


Zero trust is a data security model that aims to protect networks against all devices and users. The model assumes that any device and user can be compromised at any time, and therefore should not be trusted even if they were previously authenticated. Traditional data security approaches use firewalls and virtual private networks (VPNs) to […]

The post Why Zero Trust and XDR Are the Future of Data Security appeared first on DATAVERSITY.


Read More
Author: Gilad David Maayan

5 reasons why we have dark data


Dark data is probably here to stay, at least for the next few years. Most organizations have it, if not all. But why is that? Why is dark data so prevalent? Here are the 5 reasons why we have dark data.  Table Of Contents 1. Different priorities2. Lack of data governance3. Poor data quality4. Constraints […]

The post 5 reasons why we have dark data appeared first on LightsOnData.


Read More
Author: George Firican

Reimagining Customer Data

Brands and retailers need to reevaluate how they think about customer data

In a survey conducted by SuperOffice, it was found that 45.9% of business professionals are prioritizing customer service over products (20.5%) and price (33.6%).

There has been a customer revolution of late, brand loyalty is now not limited to just products or price; they are willing to invest more in a purchase if the customer service is above average.

It goes without saying, that customers want straightforward answers to their queries and that they appreciate brands that personalize the interaction experience from the start with offers that communicate clear expectations on what the customer can expect in return. Businesses that fail to customize the message and fail to personalize the offer in the presence (or absence ) of customer data are likely to leave customers disinterested or frustrated. Neither of these outcomes is desirable and puts retention and repeat purchases at risk.

Statistically speaking, brands that offer omnichannel experiences retain 89% of their customers compared to 33% of those that don’t. The reason this is an important “stat” to pay attention to, is that the old paradigm of perhaps exclusively engaging in business via brick-and-mortar stores often now sees those same customers expecting a digital experience too. Leveraging digital channels means that they can interact regularly with brands in a way that they couldn’t before. These could be by way of email, website chatbots, mobile apps, customer service chat sessions, Twitter, Facebook, Whatsapp, telegram, and a host of other platforms and interaction methods.

If you believe that data can fuel your digital transformation journey then you will also recognise that it offers the potential for more interaction and communciation consistency. By leveraging centrally stored well-managed detailed customer information, all manner of services and support can be made use of in the honing of the customer message to provide a personalized and distinctive customer experience.

Curbside Pickup as a data point

A curbside pickup service is one where retailers allow customers to place an order online for them to then self or courier pick up at a local store. In some respects this is an evolution of drive-through with the principle difference being that curbside pickup can simply be an extension to normal pick and pack but without the ship part.

When the order is ready, the customer is notified, either by email, SMS or mobile app message and the consumer walks or drives to the store and in a designated area collects their order. In some instances they may nominate a courier or home delivery service provider to make the collection for them. Either way, the seller is not responsible for collection/delivery beyond making the consignment available for pickup.

The COVID-19 pandemic saw demand for curbside pickup increase by 85%. Customers would often make this choice because they want to be safe and prefer the click-and-collect method instead of physically visiting the store.

For businesses that already supported a click-and-collect (C&C) operation, the pressure was more on whether infrastructure could cope with the increase in orders. For those who had never offered C&C the pressure was to implement the data capture mechanism for not just the customer details but also their payment processing, preferences, contact information and a eCommerce or webshop element. The stores would also need to be geared up to do more order-based picking where previously the main focus would have been on shelf packing and checkout.

Connecting the web front with back end systems may sound like a straightforward IT integration but often that would not be true where the logistics execution or point of sale systems operate in complete isolation from eCommerce and webshop systems. From the Pretectum perspective, this is where Customer Master Data Management can operate as a central hub for the many functional spokes that represent different aspects of business operations.

Data is a key to aligning the customer experience

98% of Fortune 500 companies leverage data to enhance the customer experience. Businesses need to have a defined data strategy that helps them scale to an ever-evolving environment.

Business decisions and marketing initiatives are ideally driven from data insights and those are best established when they come from analyzing the various aspects of your customer’s data.

Your customer data management system can serve as your single source of truth and can neutralize the concept of data silos. Silos of customer data can be very common in businesses that have implemented systems and approaches to dealing with customers in an isolated and tactical way.

Every department that is potentially customer-facing, including sales, marketing, finance, service, and support, requires specific kinds of information to undertake their role. This information when stored separately can become fragmented, inconsistent, and incomplete. thereby making it difficult for other departments to access and draw conclusions that may be tied to the data held cross-operationally.

Data silos might seem harmless and fit for purpose through the narrow lens of a particular department or function but even within a narrow frame of focus, that data will develop inconsistencies over time. With so many business area-specific data silos popping up, it will be difficult for business leaders to draw appropriate conclusions and in turn provide customers with an optimised experience.

Breaking the silos is crucial for businesses. The route to this elimination of the silos is to provide data centralization and save time (and resources) that is spent on dealing with trying to create an optimized picture of the customer and the customer circumstances

 Customer Master Data Management offers the potential for the controlled flow of batched and real-time customer data through all appropriate business channels with a consistent and unified aspect.

Almost all C suite execs believe that customer data is critical for their businesses to get ahead of competitors.

Start Small and Scale Up with Data Profiling, Data Quality, and Data Governance


Organizations today are rallying business users around using data to make better business decisions. Business users want to know where that data lives, understand if people are accessing the right data at the right time, and be assured that the data is of high quality. But they are not always out shopping for Data Quality […]

The post Start Small and Scale Up with Data Profiling, Data Quality, and Data Governance appeared first on DATAVERSITY.


Read More
Author: Emily Washington

5 Data Storage Trends to Expect in 2022


What does 2022 hold for the data storage industry? Signs of what is to come have been emerging. The following are five predictions about the data storage market, grounded in understanding the direction where the market is going. They involve AI, cyber resilience, supercharged application, workload performance and availability, and reduction of OPEX and CAPEX.  […]

The post 5 Data Storage Trends to Expect in 2022 appeared first on DATAVERSITY.


Read More
Author: Eric Herzog

3 Ways Strong Data Governance Practices Can Improve Your Business


Businesses have long struggled to find the balance between compliance and agility. This is especially true when it comes to Data Governance. According to TechTarget, Data Governance is the process of managing the availability, usability, integrity, and security of the data in enterprise systems, based on internal data standards and policies. Effective Data Governance ensures that […]

The post 3 Ways Strong Data Governance Practices Can Improve Your Business appeared first on DATAVERSITY.


Read More
Author: Jackson Shaw

2022 Predictions: Blockchain, Cloud, Machine Learning, and More


While much of last year focused on overcoming challenges associated with the COVID-19 pandemic, technology innovations have continued and demonstrated the unstoppable power of human creativity. In 2022, we can expect to see many exciting developments in Data Management, including the acceleration of blockchain technology to protect health data, real-world use cases for quantum computing, and more. […]

The post 2022 Predictions: Blockchain, Cloud, Machine Learning, and More appeared first on DATAVERSITY.


Read More
Author: Manjusha Madabushi

Four Data Analytics Trends to Watch


Now that 2021 has come to a close and leadership teams once again look to position their organizations for opportunities and challenges on the horizon, there’s no shortage of questions about what to expect in 2022 and beyond.  Will technology fix the global supply chain crisis? Will “citizen data analysts” become the most important people […]

The post Four Data Analytics Trends to Watch appeared first on DATAVERSITY.


Read More
Author: Matthew Halliday

Master Data Management OKRs


Have you started governing and managing your data?

You may have implemented a master data management program but how are you measuring success?

A basic question will be about the general health of your data governance and data management program. The best way to assess that is to look at your objectives and key results.

OKR’s are arguably a North Star for any data-related program. OKRs can be the determinants of not just how your programs are running but also whether the measures that you have in place are proper and appropriate. Do they answer fundamental questions that you need to ask about your program and more particularly, your data?

The OKR’s themselves need to have a few ecosystem attributes in place in order to be effective though, among them, a regular cadence of assessment and reporting, friction-free change and calculation, and of course purpose. We’ll cover each of these off with a little more elaboration for you to consider.

Assessment and Reporting

Hopefully, you defined your OKRs at the start or midway through your project. Defining them at the start may even have been a prerequisite to getting executive sponsorship and investment.

Your first round of assessment of your initiative should start yielding results quickly, after-all you want to keep that momentum of support going. We think that a monthly checkpoint as a minimum is a good baseline interval.

Your communication plan should be polished and honed as you learn more and more about your data and your systems, but what you will also see, is that an evolving MDG and MDM program will elicit interest from more stakeholders and interested parties than you first thought.

Sometimes, just sometimes, an initiative like this will snowball into something much greater. So it is important to run those evaluations regularly and report on the key indicators and the trend.

You’ll want to report on a number of things but in keeping with most philosophies around Data Governance and Data Quality, you will report on data creation and change velocity where the data requests are coming from, and how well aligned the requests and behaviors are with the overarching principles of your program. That means you will likely also want to report on business rule definition requests and changes too!

Friction-free change and calculation

OKRs are “living” things in the sense that they evolve over time. As the requirements of the business change, the OKRs change too. You’ll want to report with the most appropriate measures in place every time you call out progress.

For example, if you suddenly decide that keeping track of customer dates of birth is a key indicator of data quality because you use that to ensure that your data is compliant then you need to embark on a program to define, capture and maintain the date of birth and report on it!

Setting date validation ranges

Your assessment cadence can also be most effectively achieved if the tools and methods that you use can be automated. This means that you should either rely on tools that allow you to do this against a schedule or you’ll need to script in ways to do the assessment that minimize the manual intervention that would be most commonplace when you set this up for the first time.

Data Quality assessment tools are aplenty and many of the MDG and MDM technologies on the market including Pretectum’s C-MDM support in-depth data profiling and data quality assessment as fundamentals. Setting those up with key attributes as your OKR’s might be a good start.

OKR’s with purpose

We have to remember why we’re doing this in the first place. OKRs serve several purposes but the primary driver for defining and establishing is to create organizational alignment. The use of acronym FACTS is used to determine why so many companies use the OKR model. Benefits that are expected to flow are Focus, Alignment, Commitment, Tracking, and Stretching.

The MDG and MDM OKRs for data should also be visible to all company levels – because everyone is responsible for good data, everyone should have access to the OKRs. We’re defining these measurable goals related to the data and driving towards an examination of how they lead to specific outcomes for all areas of the business from marketing through sales, service, support and logistics, and potentially other groups too.

If you feel that you have happened upon or implemented some interesting, useful or distinctive OKRs around your master data management and in particular your customer master data management, I would love to hear about them.


Read More
Author: Jewel Tan

Hyperautomation Is Set for Growth in 2022: Which Tools Are Needed?


With labor shortages continuing throughout multiple industries, businesses need to revisit automation as a way of “filling” unhired roles or even eliminating tedious tasks that create worker dissatisfaction. Thoughtful automation can improve the work experience by granting employees the freedom to focus on more meaningful aspects of their jobs or by reducing the stress of […]

The post Hyperautomation Is Set for Growth in 2022: Which Tools Are Needed? appeared first on DATAVERSITY.


Read More
Author: Adam Evans

3 Cybersecurity Predictions for 2022


From high-profile ransomware attacks to government spending on improving national security, the cybersecurity industry impacted nearly every sector – including business, health care and education – in 2021. We don’t foresee this slowing down anytime soon, meaning that in 2022, companies should be aware of emerging threats and risks. Here are my cybersecurity predictions for […]

The post 3 Cybersecurity Predictions for 2022 appeared first on DATAVERSITY.


Read More
Author: Ray Canzanese

How Data Analysts Are Helping Brands Evolve in a Data-Driven World


Data is one of the most important tools brands and retailers can use to effectively meet the needs of their customers. However, privacy concerns have altered how it will be collected going forward. Consumer consent has become critical, prompting Firefox, Safari, and Chrome – three of the world’s most popular web browsers – to take measures toward requiring consumers to opt […]

The post How Data Analysts Are Helping Brands Evolve in a Data-Driven World appeared first on DATAVERSITY.


Read More
Author: Thalya Hamilton

Three SaaS and IT Predictions for 2022


When the pandemic struck, it caused us to leave our offices, work from home, and rush to the cloud. Centralized offices became decentralized networks of people working from home. Because of this, many cloud apps went from important tools to centers of gravity for our departments. Ideas that bloomed in a conference room now take root in […]

The post Three SaaS and IT Predictions for 2022 appeared first on DATAVERSITY.


Read More
Author: Uri Nativ