Q
Problem solve Get help with specific problems with your technologies, process and projects.

Find duplicate sets of child rows

I have a parent and child tables. The parent has seqno as the primary key and information as to who made a call...

and where and which form they used, etc. The child table has seqno from the parent, the question numbers on the form, and finally the answer to the question. A call is a visit to a store using a specific form which has a variable number of questions depending on the form number. I am looking for a way to find duplicate calls, done by the same person using the same form and the answers being the same. If a single answer is different the row does not qualify as duplicate. Is there a set based solution for this?

From your description, I shall assume the tables look like this:

Calls
seqno personid formid
301    12      56
302    16      75
303    12      56

Answers pseqno question answer 301 1 'y' 301 2 'n' 301 3 'y' 302 1 'n' 302 2 'n' 302 3 'n' 303 1 'y' 303 2 'n' 303 3 'n'

Person 12 filled in form 56 twice, but the answers were different the second time, so you don't want to qualify call 303 as a duplicate of 301.

I would start by joining the combined data from the Answers and Calls tables to itself, based on the question number and also on the parent personid and formid, and with the added condition that the parent seqno values be different, because you don't want to compare a call to itself --

select something
inner
join Calls
on cseqno = seqno ) X
inner
inner
join Calls
on cseqno = seqno ) Y
on X.personid = Y.personid
and X.formid   = Y.formid
and X.question = Y.question
and X.seqno    > Y.seqno

Notice that X.seqno is greater than Y.seqno -- if we had used "not equals" then since it's a self-join, each pair would come in twice. By selecting only X.seqno greater than Y.seqno, the later call will be considered the duplicate.

But what do we select? The answer is to count, for each call, the number of answers that don't match.

select X.seqno, ' is duplicated by ', Y.seqno
then 0 else 1
end ) mismatches
from ...
group
by X.seqno, Y.seqno
then 0 else 1
end )
> 0

If the answers are optional, such that one call might have an extra answer than another call for the same person for the same form, then you'll have to use an outer join and COALESCE in the CASE, and probably have to run both inequalities, X.seqno greater than Y.seqno and X.seqno less than Y.seqno. I didn't test that scenario.

This was last published in January 2003

Content

Find more PRO+ content and other member only offers, here.

Have a question for an expert?

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Start the conversation

Send me notifications when other members comment.

SearchDataManagement

• Connectedness is king, as Neo4j graph database ports to Spark

The Neo4j graph database emphasizes easy relationship mapping for diverse data points. Now, its related Cypher query language is ...

• NewSQL databases rise anew -- MemSQL, Spanner among contenders

The NewSQL database was almost hidden when Hadoop and NoSQL arose. Now, as more big data teams move toward production uses, ...

• Good data quality for analytics becomes an IT imperative

High-quality data is a must for analytics applications. That's driving more demand for data quality tools, but quality ...

• Tableau targets data preparation software with Project Maestro

As Tableau and other high-level applications look to automate more functionality, stand-alone data preparation tools have to ...

• AI components make tools more than the sum of their parts

AI applications, rather than being one monolithic tool, are built around a diverse collection of tools and techniques that ...

• At AT&T, CDO responsibilities to include all things AI

At most companies, the chief data officer role tends to focus on data governance and management issues, but at AT&T, AI is set to...

SearchSAP

• Responsible sourcing can be good for business

A company's reputation and bottom line can be damaged if its suppliers engage in harmful practices. Responsible sourcing and risk...

• SAP TechEd 2017 focuses on next-gen development tools

At SAP TechEd 2017, SAP rolled out some new developer tools that are intended to extend the SAP platform and drive development of...

• SAP Analytics Cloud helps paper-maker tell a good business story

SAP Analytics Cloud software is helping paper manufacturer Pratt Industries tell the story of monthly forecasts more accurately, ...

SearchSQLServer

• Microsoft technology refresh touches SQL Server, integration tooling

Microsoft is at work on a delicate technology refresh affecting database tuning and architecture, as well as data integration and...

• Microsoft boosts SQL Server machine learning services

Python and R are among the tools in the SQL Server machine learning toolkit. Native T-SQL scoring is also on the agenda, as ...

• Power BI updates drive Microsoft's latest hybrid cloud efforts

At PASS Summit 2017, Microsoft Azure's strides were measured in steps. These include Power BI updates that bring cloud reporting ...

TheServerSide.com

• Can DevOps problems actually cause projects to fail?

DevOps isn't perfect. There are times when DevOps problems can overwhelm the potential benefits. So, why do some DevOps projects ...

• Owning the Java Platform is more of a burden or a blessing

Oracle became stewards of the Java platform as a by-product of their acquisition of Sun Microsystems. But looking back, it seems ...

• Migrations to Oracle's Java SE 9 platform may be delayed

Oracle did a great job getting Java SE 9 released earlier this year, but modularity and various smaller updates may not be enough...

SearchDataCenter

• Data center GPU use on the rise thanks to AI, big data

GPU vendors have added new devices and cards for data center servers, as data demanding workloads infiltrated the data center and...

• SD-WAN benefits branch networks with simplicity, automation

Traditional branch networks haven't adapted well to new technologies. But a mature SD-WAN market can bring distributed networks ...

• Composable infrastructure creates new path to SDDC nirvana

Shiny new products like composable infrastructure and on-premises cloud platforms could offer a way to achieve software-defined ...

SearchContentManagement

• Q&A: New CEO bets on open source future for Acquia CMS

The Acquia CMS took the Red Hat model to content management by commercializing open source Drupal. What's next? We ask co-founder...

• CMS analytics arms businesses with a strategic planning edge

Content analytics for CMSes mines business value from free text in data lakes, so it's time to go prospecting for gold with this ...

• Enterprise content management systems boost intelligence

Content analytics moves beyond the tried-and-true web analytics style of insights, adding natural language processing and images ...

SearchFinancialApplications

• Finance IT case study: Reporting secrets of Derek Rose

CEO Sacha Rose says specialist reporting tools have saved the company thousands by avoiding unnecessary mistakes.

• WestJet turns to gamification to help its Oracle ERP users soar

WestJet's initial gamification project focuses on expense reporting.

• The Transformation of HR is Underway

HR is being transformed while we watch.

Close