Contents
Chapter 1 – Introduction and Good Advice
Give your Enterprise the Tools they Need
Educate the Business on the Business by Sharing the Model
Load Your Models and have the SQL Built Automatically
Five Brilliant Pieces of Teradata (1 of 5) is MPP
Five Brilliant Pieces (2 of 5) are Tactical Queries
Five Brilliant Pieces (3 of 5) Is a Traffic System
Five Brilliant Pieces (4 of 5) Is Viewpoint
Five Brilliant Pieces (5 of 5) Are Data Processing Options
Chapter 2 - The Teradata Architecture
The Basics of a Single Computer
Teradata Parallel Processes Data
All Teradata Tables are spread across ALL AMPS
Teradata Systems can Add AMPs for Linear Scalability
Understand that Teradata can scale to incredible size
AMPs and Parsing Engines (PEs) live inside SMP Nodes
Each Node is attached via a Network to a Disk Farm
Two SMP Nodes Connected Become One MPP System
There are Many Nodes in a Teradata Cabinet
The Boardless BYNET and the Physical BYNET
This is the Visual You Want to Know in order to Understand Teradata
The Primary Index is defined when the table is CREATED
Primary Index in the WHERE Clause - Single-AMP Retrieve
A Non-Unique Primary Index (NUPI)
Primary Index in the WHERE Clause - Single-AMP Retrieve
A conceptual example of a Multi-Column Primary Index
Primary Index in the WHERE Clause - Single-AMP Retrieve
A conceptual example of a Table with NO PRIMARY INDEX
A Full Table Scan is likely on a table with NO Primary Index
An EXPLAIN that shows a Full Table Scan
Table CREATE Examples with four different Primary Indexes
What happens when you forget the Primary Index?
Why create a table with No Primary Index (NoPI)?
Chapter 4 – Hashing of the Primary Index
The Hash Map Determines which AMP will own the Row
The Hash Map Determines which AMP will own the Row
Placing rows on the AMP Continued
A Review of the Hashing Process
Non-Unique Primary Indexes have Skewed Data
The Row Hash and Uniqueness Value make up the Row-ID
A Row-ID Example for a Unique Primary Index
A Row-ID Example for a Non-Unique Primary Index (NUPI)
Two Reasons why each AMP Sorts their rows by the Row-ID
AMPs sort their rows by Row-ID to Group like Data
AMPs sort their rows by Row-ID to do a Binary Search
Table CREATE Examples with four different Primary Indexes
Null Values all Hash to the Same AMP
A Unique Primary Index (UPI) Example
A Non-Unique Primary Index (NUPI) Example
A Multi-Column Primary Index Example
A No Primary Index (NoPI) Example
Chapter 5 - Teradata - The Cold Hard Facts
All Teradata Tables are spread across All AMPs
The Table Header and the Data Rows are Stored Separately
An AMP Stores the Rows of a Table inside a Data Block
To Read a Data Block, an AMP Moves the Block into Memory
Nothing is done on disk and everything is done in Memory
Most Taxing thing for an AMP is Moving Blocks into Memory
A Full Table Scan Means All AMPs must Read All Rows
The “Achilles Heel and slowest process is Block Transfer
Each Table has a Primary Index
A Query Using the Primary Index is a Single AMP Retrieve
As Rows are added a Data Block will Eventually Split
A Full Table Scan Means All AMPs must Read All Blocks
A Primary Index Query uses a Single AMP and Single Block
Each AMP Can Have Many Blocks for a Single Table
A Full Table Scan Means All AMPs must Read All Blocks
Quiz – How Many Blocks Move into FSG Cache?
Answer – How Many Blocks Move into FSG Cache?
Quiz – How Many Blocks Move Using the Primary Index?
Answer – How Many Blocks Move Using the Primary Index?
EXPLAIN Using a Synchronized Scan
Intelligent Memory (Teradata V14.10)
Teradata V14.10 Intelligent Memory Gives Data a Temperature
Data deemed VeryHot stays in each AMP's Intelligent Memory
Intelligent Memory Stays in Memory
What is the Goal of a Teradata Physical Database Design?
Chapter 6 – Inside the AMPs Disk
Rows are Stored in Data Blocks which are stored in Cylinders
An AMP's rows are stored inside a Data Block in a Cylinder
An AMP's Master Index is used to find the Right Cylinder
The Row Reference Array (RRA) Does the Binary Search?
A Block Splits into Two Blocks at Maximum Block Size
Data Blocks Maximum Block Size has Changed (V14.10)
The New Block Split with Teradata V14.10
The Block Split with Even More Detail in Teradata V14.10
Teradata V14.10 Block Split Defaults
There is One Master Index and Thousands of Cylinder Indexes
Blocks Continue to Split as Tables Grow Larger
FYI – Some Advanced Information about Data Block Headers
There are Hot, Warm, and Cold Cylinders
Cylinders are used for Perm, Spool, Temp, and Journals
Each AMP has Their Own Master Index
Each Cylinder on an AMP has a Cylinder Index
Quiz – What Two Things Does and AMP Read?
Answer – What Two Things Does and AMP Read?
Quiz – How Many Row Reference Arrays do you see?
Answer – How Many Row Reference Arrays do you see?
Quiz – How Many Row Reference Arrays are there Now?
Answer – How Many Row Reference Arrays do you see?
Quiz – How Many Row Reference Arrays in Total?
Answer – How Many Row Reference Arrays in Total?
Quiz – How Many Cylinder Indexes are here?
Answer – How Many Cylinder Indexes are here?
A More Detailed Illustration of the Master Index
A Real-World View of the Master Index
An Even More Realistic View of an AMP's Master Index
An Even More Realistic View of a Cylinder Index
How a Query using the Primary Index works
How the AMPs Do a Full Table Scan
How an AMP Reads Using a Primary Index
Chapter 7 - Partition Primary Index (PPI) Tables
The Concept behind Partitioning a Table
Creating a PPI Table with Simple Partitioning
A Visual Display of Simple Partitioning
An SQL Example that explains Simple Partitioning
Creating a PPI Table with RANGE_N Partitioning per Month
A Visual of One Year of Data with Range_N per Month
An SQL Example explaining Range_N Partitioning per Month
A Partition # and Row-ID = Row Key
An AMP Stores its Rows Sorted in only Two Different Ways
Creating a PPI Table with RANGE_N Partitioning per Day
A Visual of Range_N Partitioning Per Day
An SQL Example that explains Range_N Partitioning per Day
Creating a PPI Table with RANGE_N Partitioning per Week
A Visual of Range_N Partitioning Per Week
SQL Example that explains Range_N Partitioning per Week
Creating a PPI Table with CASE_N
A Visual of Case_N Partitioning
An SQL Example that explains CASE_N Partitioning
How many partitions do you see?
Number of PPI Partitions Allowed
How many partitions do you see?
NO CASE and UNKNOWN Partitions Together
A Visual of Case_N Partitioning
Combining Older Data and Newer Data in PPI
A Visual for Combining Older Data and Newer Data in PPI
The SQL on Combining Older Data and Newer Data in PPI
Multi-Level Partitioning Combining Range_N and Case_N
A Visual of Multi-Level Partitioning
The SQL on a Multi-Level Partitioned Primary Index
NON-Unique Primary Indexes (NUPI) in PPI
PPI Table with a Unique Primary Index (UPI)
Tricks for Non-Unique Primary Indexes (NUPI)
Character Based PPI for RANGE_N
A Visual for Character-Based PPI for RANGE_N
The SQL on Character-Based PPI for RANGE_N
Character-Based PPI for CASE_N
Dates and Character-Based Multi-Level PPI
Using CURRENT_DATE to define a PPI
ALTER to CURRENT_DATE the next year
ALTER to CURRENT_DATE with Save
Altering a PPI Table to Add or Drop Partitions
Deleting a Partition and saving its contents
Using the PARTITION Keyword in your SQL
Columnar Tables have NO Primary Index
NoPI Tables Spread rows across all-AMPs Evenly
NoPI Tables used as Staging Tables for Data Loads
What does a Columnar Table look like?
Comparing Normal Table vs. Columnar Tables
Example of Columnar CREATE Statement
Columnar can move just One Container to Memory
Containers on AMPs match up perfectly to rebuild a Row
Indexes can be used on Columns (Containers)
Indexes can be used on Columns (Containers)
Single-Column vs. Multi-Column Containers
Comparing Normal Table vs. Columnar Tables
Columnar Row Hybrid CREATE Statement
Columnar Row Hybrid Query Example
Review of Row-Based Partition Primary Index (PPI)
Visual of Row Partitioning (PPI Tables) by Month
CREATE Statement for both Row and Column Partition
Visual of Row Partitioning (PPI Tables) and Columnar
How to Load into a Columnar Table
Auto Compress in Columnar Tables
Auto Compress Techniques in Columnar Tables
When and When NOT to use Columnar Tables
When your System Arrives, there is only User named DBC
First Assignment is to create another User just under DBC
Perm Space is for Permanent Tables
Spool Space is work space that builds a User's Answer Sets
Spool Space is in an AMP's Memory and on its Disk
Users are Assigned Spool Space Limits
What is the Purpose of Spool Limits?
Why did my query Abort and say “Out of Spool”?
How can Skewed Data cause me to run “Out of Spool”?
Why did my Join cause me to run “Out of Spool”?
Finding out how much Space you have
Space per AMP on all tables in a Database shows Skew
What does my system look like when it first arrives?
DBC owns all the PERM Space in the system on day one
DBC's First Assignment is Spool Space
DBC's 2nd Assignment is to CREATE Users and Databases
The Teradata Hierarchy Continues
Differences between PERM and SPOOL
What are Similarities between a DATABASE and a USER?
What is the Difference between a DATABASE and a USER?
Objects that take up PERM Space
A Series of Quizzes on Adding and Subtracting Space
Chapter 10 – The User Environment
DBC is the only user when the system first arrives
DBC will Create Databases and Give them Space
DBC will create some initial Users
A Typical Teradata Environment
What are Similarities between a DATABASE and a USER?
Create a Role and then Assign that Role Its Access Rights
Create a User and Assign them a Default Role
There are Three Types of Access Rights
Description of the Three Types of Access Rights
ProfileInfoVX, RoleMembers, RoleInfo and UserRoleRights
Accounts and their Associated Priorities
Creating a User with Multiple Account Priorities
Account String Expansion (ASE)
Teradata TASM provides a User Traffic System
Chapter 11 - Secondary Indexes
Creating a Unique Secondary Index (USI)
What is in a Unique Secondary Index (USI) Subtable?
A Unique Secondary Index (USI) Subtable is hashed
How the Parsing Engine uses the USI Subtable
Creating a Non-Unique Secondary Index (NUSI)
What is in a Unique Secondary Index (USI) Subtable?
Non-Unique Secondary Index (NUSI) Subtable is AMP Local
How the Parsing Engine uses the NUSI Subtable
The Hash Map Determines which AMP will own the Row
A Unique Primary Index Spreads the Data Evenly
Quiz – Answer the Tough USI Questions
Answer to Quiz – Answer the Tough USI Questions
A Picture with a Base Table, USI, and NUSI Subtable
Quiz – Tough Questions on the USI and NUSI Subtables
Answer – Tough Questions on the USI and NUSI Subtables
A Query Using an USI Only Moves Two Blocks
A Query Using A NUSI Always Uses All AMPs
Two Non-Unique Secondary Indexes (NUSI) on a Table
A NUSI Bitmap in Action (3 of 3)
A Brilliant Technique for a Unique Secondary Index
The USI for Partitioned Tables Points to the Row Key
A Brilliant Technique for a Non-Unique Secondary Index
The NUSI for Partitioned Tables Points to the Row Key
How the PE Decides on the NUSI or the Full Table Scan
What are the Big Four Tactical Queries?
What are the Big Four Tactical Queries?
Chapter 12 - Temporal Tables Create Functions
Three types of Temporal Tables
Bi-Temporal Data Type Standards
Bi-Temporal Example – Tera-Tom buys!
A Look at the Temporal Results
Bi-Temporal Example – Tera-Tom Sells!
Bi-Temporal Example – How the data looks!
Normal SQL for Bi-Temporal Tables
NONSEQUENCED SQL for Temporal Tables
Creating Views for Temporal Tables
Bi-Temporal Example – Socrates is DELETED!
Bi-Temporal Results – Socrates is DELETED
Chapter 13 - How Joins Work Internally
Teradata Moves Joining Rows to the Same AMP
Imagine Joining Two NoPI Tables that have No Primary Index
Both Tables are redistributed to Join Rows on the Same AMP
How do you join if One Table is Big and One Table is Small?
Duplicate the Small Table on Every AMP (like a mirror)
What Could You Do If Two Tables Joined 1000 Times a Day?
Joining Two Tables with the same PK/FK Primary Index
A Join with No Redistribution or Duplication
A Performance Tuning Technique for Large Joins
The Joining of Two Tables with an Additional WHERE Clause
An Example of the Fastest Join Possible
A Volatile Table with a Primary Index
Using a Simple Global Temporary Table
Two Brilliant Techniques for Global Temporary Tables
The Joining of Two Tables Using a Global Temporary Table
Quiz – How Much Data Moves Across the BYNET?
Answer – How Much Data Moves Across the BYNET?
Teradata V14.10 Join Feature PRPD
Creating a Multi-Table Join Index
Outer Join Multi-Table Join Index
Visual of a Left Outer Join Index
Compressed Multi-Table Join Index
A Visual of a Compressed Multi-Table Join Index
Creating a Single-Table Join Index
Conceptual of a Single Table Join Index on an AMP
Single Table Join Index Great For LIKE Clause
Single Table Join Index with Value Ordered NUSI
Compressed Single-Table Join Index
New Aggregate Join Index (Teradata V14.10)
A Global Multi-Table Join Index
Chapter 15 - Basic SQL Functions
SELECT * (All Columns) in a Table
SELECT Specific Columns in a Table
Using the Best Form for Writing SQL
Commas in the Front or in the Back?
Place your Commas in front for better Debugging Capabilities
Sort the Data with the ORDER BY Keyword
ORDER BY Defaults to Ascending
Use the Name or the Number in your ORDER BY Statement
Two Examples of ORDER BY using Different Techniques
Changing the ORDER BY to Descending Order
NULL Values sort First in Ascending Mode (Default)
NULL Values sort Last in Descending Mode (DESC)
Multiple Sort Keys using Names vs. Numbers
Sorts are Alphabetical, NOT Logical
Using A CASE Statement to Sort Logically
A Missing Comma can by Mistake become an Alias
The Title Command and Literal Data
Comments using Double Dashes are Single Line Comments
Comments for Multi-Lines as Double Dashes per Line
A Great Technique for Comments to Look for SQL Errors
The WHERE Clause limits Returning Rows
Using a Column ALIAS throughout the SQL
Double Quoted Aliases are for Reserved Words and Spaces
Character Data needs Single Quotes in the WHERE Clause
Character Data needs Single Quotes, but Numbers Don't
NULL means UNKNOWN DATA so Equal (=) won't Work
Use IS NULL or IS NOT NULL when dealing with NULLs
NULL is UNKNOWN DATA so NOT Equal won't Work
Use IS NULL or IS NOT NULL when dealing with NULLs
Using Greater Than OR Equal To (>=)
Using GE as Greater Than or Equal To (>=)
OR must utilize the Column Name Each Time
Troubleshooting Character Data
Using Different Columns in an AND Statement
Quiz – How many rows will return?
Answer to Quiz – How many rows will return?
What is the Order of Precedence?
Using Parentheses to change the Order of Precedence
Using an IN List in place of OR
The IN List is an Excellent Technique
IN List vs. OR brings the same Results
A Technique for Handling Nulls with a NOT IN List
An IN List with the Keyword ANY
A NOT IN List with the Keywords NOT = ALL
BETWEEN Works for Character Data
LIKE uses Wildcards Percent ‘%’ and Underscore ‘_’
LIKE command Underscore is Wildcard for one Character
LIKE ALL means ALL conditions must be Met
LIKE ANY means ANY of the Conditions can be Met
IN ANSI Transaction Mode Case Matters
In Teradata Transaction Mode Case Doesn't Matter
LIKE Command Works Differently on Char Vs. Varchar
Troubleshooting LIKE Command on Character Data
Quiz – Which Data is Left Justified and Which is Right?
Numbers are Right Justified and Character Data is Left
Answer – Which Data is Left Justified and Which is Right?
An Example of Data with Left and Right Justification
A Visual of CHARACTER Data vs. VARCHAR Data
Use the TRIM command to remove spaces on CHAR Data
TRIM Eliminates Leading and Trailing Spaces
Escape Character in the LIKE Command changes Wildcards
Escape Characters Turn off Wildcards in the LIKE Command
ANSWER – To Find that Wildcard
Chapter 17 - Distinct Vs. Group By
Rules of Thumb for DISTINCT vs. GROUP BY
GROUP BY Vs. DISTINCT – Good Advice
Quiz – How many rows come back from the Distinct?
Answer – How many rows come back from the Distinct?
TOP Command is brilliant when ORDER BY is used!
How the TOP Command WITH TIES Decides
The TOP Command will NOT work with Certain Commands
Determining the Release of your Teradata System
SHOW Table command for Table DDL
SHOW View command for View Create Statement
SHOW Macro command for Macro Create Statement
SHOW Trigger command for Trigger Create Statement
Chapter 21 - Aggregation Function
Quiz – You calculate the Answer Set in your own Mind
Answer – You calculate the Answer Set in your own Mind
Quiz – How many rows come back?
GROUP BY when Aggregates and Normal Columns Mix
GROUP BY Delivers one row per Group
GROUP BY Dept_No or GROUP BY 1 the same thing
Limiting Rows and Improving Performance with WHERE
WHERE Clause in Aggregation limits unneeded Calculations
Keyword HAVING tests Aggregates after they are Totaled
Keyword HAVING is like an Extra WHERE Clause for Totals
Getting the Average Values per Column
Average Values per Column for All Columns in a Table
Three types of Advanced Grouping
Use the Nexus for all Groupings
Testing Your Knowledge – Basic Aggregation
Testing Your Knowledge – Multiple Aggregates
Testing Your Knowledge- Group By
Testing Your Knowledge – Using a Where Clause
Testing Your Knowledge- Using Having
Final Answer to Test Your Knowledge on Aggregates
A two-table join using Non-ANSI Syntax
A two-table join using Non-ANSI Syntax with Table Alias
Aliases and Fully Qualifying Columns
A two-table join using ANSI Syntax
Both Queries have the same Results and Performance
Quiz – Can You Finish the Join Syntax?
Answer to Quiz – Can You Finish the Join Syntax?
Quiz – Can You Find the Error?
Answer to Quiz – Can You Find the Error?
Quiz – Which rows from both tables Won't Return?
Answer to Quiz – Which rows from both tables Won't Return?
LEFT OUTER JOIN Brings Back All Rows in the Left Table
RIGHT OUTER JOIN Brings Back All Rows in the RIGHT Table
FULL OUTER JOIN Brings Back All Rows in All Tables
Which Tables are the Left and which are the Right?
Answer - Which Tables are the Left and which are the Right?
INNER JOIN with Additional AND Clause
ANSI INNER JOIN with Additional AND Clause
ANSI INNER JOIN with Additional WHERE Clause
OUTER JOIN with Additional WHERE Clause
OUTER JOIN with Additional AND Clause
Results from OUTER JOIN with Additional AND Clause
Quiz – Why is this considered an INNER JOIN?
Result Set of the DREADED Product Join
The Horrifying Cartesian Product Join
The ANSI Cartesian Join will ERROR
Quiz – Do these Joins Return the Same Answer Set?
Answer – Do these Joins Return the Same Answer Set?
The Self Join with ANSI Syntax
Quiz – Will both queries bring back the same Answer Set?
Answer – Will both queries bring back the same Answer Set?
Quiz – Will both queries bring back the same Answer Set?
Answer – Will both queries bring back the same Answer Set?
How would you Join these two tables?
How would you Join these two tables? You Can't Yet!
An Associative Table is a Bridge that Joins Two Tables
Quiz – Can you Write the 3-Table Join?
Answer to Quiz – Can you Write the 3-Table Join?
Quiz – Can you Write the 3-Table Join to ANSI Syntax?
Answer – Can you Write the 3-Table Join to ANSI Syntax?
Quiz – Can you Place the ON Clauses at the End?
Answer – Can you Place the ON Clauses at the End?
The 5-Table Join – Logical Insurance Model
Quiz - Write a Five Table Join Using ANSI Syntax
Answer - Write a Five Table Join Using ANSI Syntax
Quiz - Write a Five Table Join Using ANSI Syntax
Answer - Write a Five Table Join Using ANSI Syntax
Quiz - Write a Five Table Join Using Non-ANSI Syntax
Answer - Write a Five Table Join Using Non-ANSI Syntax
Quiz –Re-Write this putting the ON clauses at the END
Answer –Re-Write this putting the ON clauses at the END
The Nexus Query Chameleon Writes the SQL for Users.
Date, Time, and Current_Timestamp Keywords
Dates are stored internally as INTEGERS from a Formula
Displaying Dates for INTEGERDATE and ANSIDATE
Changing the DATEFORM in Client Utilities such as BTEQ
Date, Time, and Timestamp Recap
Finding the Number of Hours between Timestamps
Add or Subtract Days from a date
A Summary of Math Operations on Dates
Using a Math Operation to find your Age in Years
Find What Day of the week you were Born
Using the ADD_MONTHS Command to Add 1 Year
Using the ADD_MONTHS Command to Add 5 Years
CURRENT_DATE and EXTRACT or Current_Date and Math
CAST the Date of January 1, 2011 and the Year 1800
Using the System Calendar in Its Simplest Form
How to really use the Sys_Calendar.Calendar
Storing TIME with TIME ZONE Internally
Storing Timestamp with TIME ZONE Internally
Storing Date, Time, and Timestamp with Zone Internally
Creating a Sample Table for Time Zone Examples
Inserting Rows in the Sample Table for Time Zone Examples
Selecting the Data from our Time Zone Table
Normalizing our Time Zone Table with a CAST
Intervals for Date, Time and Timestamp
Interval Data Types and the Bytes to Store Them
The Basics of a Simple Interval
Troubleshooting the Basics of a Simple Interval
A Complex Time Interval Example using CAST
A Complex Time Interval Example using CAST
An OVERLAPS Example that Returns No Rows
The OVERLAPS Command using TIME
The OVERLAPS Command using a NULL Value
The Basics of the FORMAT Command
Quiz – How will the Date Appear after Formatting
Answer to Quiz – How will the Date Appear after Formatting
Quiz – How will the Date Appear after Formatting
Answer to Quiz – How will the Date Appear after Formatting
Formatting with MMM for the Abbreviated Month
Answer to Quiz – How will the Date Appear after Formatting
Formatting with MMMM for the Full Month Name
Formatting with MMMM for the Full Month
Formatting with DDD for the Julian Day
Formatting with DDD for the Julian Day
Formatting with EEE or EEEE for the Day of the Week
EEEE for the Abbreviated or Full Day of the Week
Placing Spaces inside your Formatting Commands with a B
Troubleshooting when Formatted Data Overflows
Troubleshooting when Formatted Data Overflows
Formatting with $ and Commas Visual
Formatting with $ and Commas and 9
Formatting with $ and Commas and 9 with Zero Dollars
A Great Formatting Example for Day, Month, and Year
A Trick to get SQL Assistant to Format Data
Using the CASESPECIFIC (CS) Command in Teradata Mode
Using NOT CASESPECIFIC (CS) in ANSI Mode
On-Line Analytical Processing (OLAP) or Ordered Analytics
Cumulative Sum (CSUM) Command and how OLAP Works
OLAP Commands always Sort (ORDER BY) in the Command
Calculate the Cumulative Sum (CSUM) after Sorting the Data
The OLAP Major Sort Key and the Minor Sort Key(s)
Troubleshooting OLAP – My Data isn't coming back correct
GROUP BY in Teradata OLAP Syntax Resets on the Group
CSUM the Number 1 to get a Sequential Number
A Single GROUP BY Resets each OLAP with Teradata Syntax
A Better Choice – The ANSI Version of CSUM
The ANSI Version of CSUM – The Sort Explained
The ANSI CSUM – Rows Unbounded Preceding Explained
The ANSI CSUM – Making Sense of the Data
The ANSI CSUM – Making Even More Sense of the Data
The ANSI CSUM – The Major and Minor Sort Key(s)
The ANSI CSUM – Getting a Sequential Number
Troubleshooting the ANSI OLAP on a GROUP BY
The ANSI OLAP – Reset with a PARTITION BY Statement
PARTITION BY only Resets a Single OLAP not ALL of them
The Moving SUM (MSUM) and Moving Window
How the Moving Sum is calculated
How the Sort works for Moving SUM (MSUM)
GROUP BY in the Moving SUM does a Reset
Quiz – Can you make the Advanced Calculation in your mind?
Answer to Quiz for the Advanced Calculation in your mind?
Quiz – Write that Teradata Moving Average in ANSI Syntax
Both the Teradata Moving SUM and ANSI Version
The ANSI Moving Window is Current Row and Preceding
How ANSI Moving Average Handles the Sort
Quiz – How is that Total Calculated?
Answer to Quiz – How is that Total Calculated?
Moving SUM every 3-rows Vs. a Continuous Average
Partition BY Resets an ANSI OLAP
The Moving Average (MAVG) and Moving Window
How the Moving Average is calculated
How the Sort works for Moving Average (MAVG)
GROUP BY in the Moving Average does a Reset
Quiz – Can you make the Advanced Calculation in your mind?
Answer to Quiz for the Advanced Calculation in your mind?
Quiz – Write that Teradata Moving Average in ANSI Syntax
Both the Teradata Moving Average and ANSI Version
The ANSI Moving Window is Current Row and Preceding
How ANSI Moving Average Handles the Sort
Quiz – How is that Total Calculated?
Answer to Quiz – How is that Total Calculated?
Quiz – How is that 4th Row Calculated?
Answer to Quiz – How is that 4th Row Calculated?
Moving Average every 3-rows Vs. a Continuous Average
Partition BY Resets an ANSI OLAP
Moving Difference (MDIFF) Visual
Moving Difference using ANSI Syntax
Moving Difference using ANSI Syntax with Partition By
Trouble Shooting the Moving Difference (MDIFF)
Using the RESET WHEN Option in Teradata (V13)
How Many Months per Product_ID has Revenue Increased?
How to get Rank to Sort in Ascending Order
Two ways to get Rank to Sort in Ascending Order
RANK using ANSI Syntax Defaults to Ascending Order
Getting RANK using ANSI Syntax to Sort in DESC Order
RANK () OVER and PARTITION BY with a QUALIFY
Quiz – How can you simplify the QUALIFY Statement
Answer to Quiz –Can you simplify the QUALIFY Statement
The QUALIFY Statement without Ties
The QUALIFY Statement with Ties
The QUALIFY Statement with Ties Brings back Extra Rows
Mixing Sort Order for QUALIFY Statement
Quiz – What Caused the RANK to Reset?
Answer to Quiz – What Caused the RANK to Reset?
Answer to Quiz – Name those Sort Orders
PERCENT_RANK () OVER with 14 rows in Calculation
PERCENT_RANK () OVER with 21 rows in Calculation
Quiz – What Cause the Product_ID to Reset
Answer to Quiz – What Causes the Product_ID to Reset
Answer to Quiz – What Causes the Product_ID to Reset
COUNT OVER for a Sequential Number
Quiz – What caused the COUNT OVER to Reset?
Answer to Quiz – What caused the COUNT OVER to Reset?
MAX OVER with PARTITION BY Reset
Finding a Value of a Column in the Next Row with MIN
Finding a Value of a Date in the Next Row with MIN
The CSUM for Each Product_ID for the First 3 Days
Answer to Quiz – Fill in the Blank
Quiz – How did the Row_Number Reset?
Quiz – How did the Row_Number Reset?
Row_Number with Qualify to get the Typical Rows per Value
A Second Typical Rows per Value Query on Sale_Date
Chapter 26 - The Quantile Function
The Quantile Function and Syntax
A Quantile Example using DESC Mode
QUALIFY to find Products in the top Partitions
QUALIFY to find Products in the top Partitions Sorted DESC
QUALIFY to find Products in the top Partitions Sorted ASC
QUALIFY to find Products in top Partitions with Tiebreaker
Using Tertiles (Partitions of Four)
There are three types of Temporary Tables
Aliasing the Column Names in the Derived Table
Most Derived Tables Are Used To Join To Other Tables
Multiple Ways to Alias the Columns in a Derived Table
Our Join Example with a Different Column Aliasing Style
Column Aliasing Can Default for Normal Columns
CREATING a Derived Table using the WITH Command
Our Join Example With the WITH Syntax
The Same Derived Query shown Three Different Ways
Answer to Quiz - Answer the Questions
Clever Tricks on Aliasing Columns in a Derived Table
A Derived Table lives only for the lifetime of a single query
An Example of Two Derived Tables in a Single Query
Defining the WITH Recursive Derived Table
Looping Through the WITH Recursive Derived Table
Looping Through the WITH Recursive Derived Table
Looping Through the WITH Recursive Derived Table
Looping Through the WITH Recursive Derived Table
Looping Through the WITH Recursive Derived Table
You Populate a Volatile Table with an INSERT/SELECT
The Three Steps to Use a Volatile Table
Why Would You Use the ON COMMIT DELETE ROWS?
The HELP Volatile Table Command Shows your Volatiles
A Volatile Table with a Primary Index
The Joining of Two Tables Using a Volatile Table
You Can Collect Statistics on Volatile Tables
The New Teradata V14 Way to Collect Statistics
Four Examples of Creating a Volatile Table Quickly
Four Advanced Examples of Creating a Volatile Table Quickly
Creating Partitioned Primary Index (PPI) Volatile Tables
Using a Volatile Table to Get Rid of Duplicate Rows
Using a Simple Global Temporary Table
Two Brilliant Techniques for Global Temporary Tables
The Joining of Two Tables Using a Global Temporary Table
CREATING A Global Temporary Table
Chapter 28 - Sub-query Functions
An IN List is much like a Subquery
An IN List Never has Duplicates – Just like a Subquery
The Final Answer Set from the Subquery
Quiz- Answer the Difficult Question
Answer to Quiz- Answer the Difficult Question
Should you use a Subquery of a Join?
Answer to Quiz- Write the Subquery
Quiz- Write the More Difficult Subquery
Answer to Quiz- Write the More Difficult Subquery
Quiz- Write the Subquery with an Aggregate
Answer to Quiz- Write the Subquery with an Aggregate
Quiz- Write the Correlated Subquery
Answer to Quiz- Write the Correlated Subquery
The Basics of a Correlated Subquery
The Top Query always runs first in a Correlated Subquery
The Bottom Query runs last in a Correlated Subquery
Quiz- Who is coming back in the Final Answer Set?
Answer- Who is coming back in the Final Answer Set?
Correlated Subquery Example vs. a Join with a Derived Table
Quiz- A Second Chance to Write a Correlated Subquery
Answer - A Second Chance to Write a Correlated Subquery
Quiz- A Third Chance to Write a Correlated Subquery
Answer - A Third Chance to Write a Correlated Subquery
Quiz- Last Chance to Write a Correlated Subquery
Answer – Last Chance to Write a Correlated Subquery
Correlated Subquery that Finds Duplicates
Answer to Quiz- Write the NOT Subquery
Quiz- Write the Subquery using a WHERE Clause
Answer - Write the Subquery using a WHERE Clause
Quiz- Write the Subquery with Two Parameters
Answer to Quiz- Write the Subquery with Two Parameters
How the Double Parameter Subquery Works
More on how the Double Parameter Subquery Works
Quiz – Write the Triple Subquery
Answer to Quiz – Write the Triple Subquery
Quiz – How many rows return on a NOT IN with a NULL?
Answer – How many rows return on a NOT IN with a NULL?
How to handle a NOT IN with Potential NULL Values
How a Correlated Exists matches up
The Correlated NOT Exists Answer Set
Quiz – How many rows come back from this NOT Exists?
Answer – How many rows come back from this NOT Exists?
Chapter 29 - Substrings and Positioning Functions
The CHARACTERS Command Counts Characters
The CHARACTERS Command – Spaces can Count too
The CHARACTERS Command and Char (20) Data
Troubleshooting the CHARACTERS Command
TRIM for Troubleshooting the CHARACTERS Command
CHARACTERS and CHARACTER_LENGTH equivalent
The TRIM Command trims both Leading and Trailing Spaces
Trim and Trailing is Case Sensitive
Trim and Trailing works if Case right
Trim Combined with the CHARACTERS Command
How to TRIM only the Trailing Spaces
How to TRIM Trailing Letters and use CHARACTER_Length
How SUBSTRING Works with NO ENDING POSITION
Using SUBSTRING to move Backwards
How SUBSTRING Works with a Starting Position of -1
How SUBSTRING Works with an Ending Position of 0
An Example using SUBSTRING, TRIM and CHAR Together
SUBSTRING and SUBSTR are equal, but use differe,nt syntax
The POSITION Command finds a Letters Position
The POSITION Command is brilliant with SUBSTRING
Quiz – Name that SUBSTRING Starting and For Length
The POSITION Command is brilliant with SUBSTRING
Quiz – Name that SUBSTRING Starting and For Length
Answer to Quiz – Name that Starting and For Length
Answer to Quiz – Name that Starting and For Length
Using the SUBSTRING to Find the Second Word On
Quiz – Why did only one Row Return
Answer to Quiz – Why Did only one Row Return
Chapter 30 - Interrogating the Data
Quiz – What would the Answer be?
Answer to Quiz – What would the Answer be?
Quiz – Fill in the Blank Values in the Answer Set
Answer to Quiz – Fill in the Blank Values in the Answer Set
Answer to Quiz – Fill in the Blank Values in the Answer Set
Quiz – Fill in the Answers for the NULLIF Command
Quiz – Fill in the Answers for the NULLIF Command
Answer to the ZEROIFNULL Question
The Basics of CAST (Convert and Store)
Some Great CAST (Convert and Store) Examples
Some Great CAST (Convert and Store) Examples
Some Great CAST (Convert and Store) Examples
A Teradata Extension – The Implied Cast
The Basics of the CASE Statements
The Basics of the CASE Statement shown visually
Answer - Valued Case Statement
Quiz - Searched Case Statement
Answer - Searched Case Statement
Quiz - When NO ELSE is present in CASE Statement
Answer - When NO ELSE is present in CASE Statement
When an ELSE is present in CASE Statement
When NO ELSE is present in CASE Statement
When an Alias is NOT used in a CASE Statement
When an Alias is NOT used in a CASE Statement
When NO ELSE is present in CASE Statement
Combining Searched Case and Valued Case
A Trick for getting a Horizontal Case
Exceptions to the ORDER BY Rule inside a View
Views sometimes CREATED for Formatting or Row Security
Another Way to Alias Columns in a View CREATE
Resolving Aliasing Problems in a View CREATE
Resolving Aliasing Problems in a View CREATE
Resolving Aliasing Problems in a View CREATE
CREATING Views for Complex SQL such as Joins
WHY certain columns need Aliasing in a View
Creating Views for Temporal Tables
Altering a Table after a View has been created
A View that errors After an ALTER
Updating Data in a Table through a View
Maintenance Restrictions on a Table through a View
CREATING and EXECUTING a Simple Macro
Multiple SQL Statements inside a Macro
Passing an INPUT Parameter to a Macro
Troubleshooting a Macro with INPUT Parameters
Troubleshooting a Macro with INPUT Parameters
An UPDATE Macro with Two Input Parameters
Executing a Macro with Named (Not Positional) Parameters
Chapter 33 - Set Operators Functions
An Equal Amount of Columns in both SELECT List
Columns in the SELECT list should be from the same Domain
The Top Query handles all Aliases
The Bottom Query does the ORDER BY (a Number)
Great Trick: Place your Set Operator in a Derived Table
A Great Example of how EXCEPT works
USING Multiple SET Operators in a Single Request
Changing the Order of Precedence with Parentheses
Using UNION ALL for speed in Merging Data Sets
Using UNION to be same as GROUP BY GROUPING SETS
Using UNION to be same as GROUP BY ROLLUP
Using UNION to be the same as GROUP BY Cube
Using UNION to be same as GROUP BY Cube
Using UNION to be same as GROUP BY Cube
Chapter 34 – Creating Tables, Secondary Indexes, and Join Indexes
Creating a Table with a Unique Primary Index
Creating a Table with a Non-Unique Primary Index
Creating a Table without entering a Primary Index
Creating a Table with NO Primary Index
Creating a Set Table with a Unique Primary Index
Creating a Set Table with a Unique Secondary Index
Creating a Table with an UPI and USI
Creating a Table with a Multicolumn Primary Index
Creating a Unique Secondary Index (USI) after a table is created
Creating a Non-Unique Secondary Index (NUSI) after a table is created
Major Data Types and the number of Bytes they take up
Making a NOT-So-Exact Copy a Table
Troubleshooting Copying and Changing the Primary Index
Copying only specific columns of a table
Copying a Table and Keeping the Statistics
Copying a Table with Statistics
Copying a table Structure with NO Data but Statistics
Creating a Table with Fallback
Creating a Table with No Fallback
Creating a Table with a Before Journal
Creating a Table with a Dual Before Journal
Creating a Table with an After Journal
Creating a Table with a Dual After Journal
Creating a Table with a Journal Keyword Alone
Creating a Table with Customization of the Data Block Size
Creating a Table with Customization with FREESPACE Percent
Example of how a Queue Table Works
Example of how a Queue Table Works
Creating a Columnar Table with Multi-Column Containers
Creating a Columnar Table with a Row Hybrid
Creating a Columnar Table with both Row and Column Partitions
How to Load into a Columnar Table
Creating a Columnar Table with NO AUTO COMPRESS
Explaining Bi-Temporal PERIOD Data Types
Creating a PPI Table with Simple Partitioning
Creating a PPI Table with RANGE_N Partitioning per Day
Creating a PPI Table with RANGE_N Partitioning per Month
A Visual of One Year of Data with Range_N per Month
Creating a PPI Table with RANGE_N Partitioning per Week
Creating a PPI Table with CASE_N
A Visual of Case_N Partitioning
Number of PPI Partitions Allowed
NO CASE and UNKNOWN Partitions Together
Combining Older Data and Newer Data in PPI
A Visual for Combining Older Data and Newer Data in PPI
Multi-Level Partitioning Combining Range_N and Case_N
A Visual of Multi-Level Partitioning
NON-Unique Primary Indexes (NUPI) in PPI
PPI Table with a Unique Primary Index (UPI)
Tricks for Non-Unique Primary Indexes (NUPI)
A Brilliant Technique for a Unique Secondary Index
A Brilliant Technique for a Non-Unique Secondary Index
Character Based PPI for RANGE_N
Character-Based PPI for CASE_N
Dates and Character-Based Multi-Level PPI
Using CURRENT_DATE to define a PPI
ALTER to CURRENT_DATE the next year
ALTER to CURRENT_DATE with Save
Altering a PPI Table to Add or Drop Partitions
Deleting a Partition and saving its contents
Using the PARTITION Keyword in your SQL
SQL – User Defined Functions (UDF)
Creating a Multi-Table Join Index
Outer Join Multi-Table Join Index
Visual of a Left Outer Join Index
Compressed Multi-Table Join Index
Creating a Single-Table Join Index
Compressed Single-Table Join Index
A Global Multi-Table Join Index
Chapter 35 - Data Manipulation Language (DML)
INSERT/SELECT Example using All Columns (*)
INSERT/SELECT Example with Less Columns
INSERT/SELECT to Build a Data Mart
NOT quite the Fast Path INSERT/SELECT
UNION for the Fast Path INSERT/SELECT
BTEQ for the Fast Path INSERT/SELECT
The UPDATE Command Basic Syntax
Subquery UPDATE Command Syntax
Example of Subquery UPDATE Command
Example of an UPDATE Join Command
The DELETE Command Basic Syntax
Two DELETE Examples to DELETE ALL Rows in a Table
A DELETE Example Deleting only Some of the Rows
Subquery and Join DELETE Command Syntax
Example of Subquery DELETE Command
Example of Join DELETE Command
MERGE INTO Example that Matches
MERGE INTO Example that does NOT Match
Chapter 36 - Stored Procedure Functions
How you CALL a Stored Procedure
Label all BEGIN and END statements except the first ones
How to Declare a Variable and then SET the Variable
An IN Variable is passed to the Procedure during the CALL
The IN, OUT and INOUT Parameters
Using IF inside a Stored Procedure
Example of two Stored Procedures with different techniques
Using Loops in Stored Procedures
You can Name the First Begin and End if you choose
Using Keywords LEAVE vs. UNTIL for LEAVE vs. REPEAT
Stored Procedure Basic Assignment
Answer - Stored Procedure Basic Assignment
Stored Procedure Advanced Assignment
Answer - Stored Advanced Assignment
Chapter 37 - Trigger Functions
FOR EACH STATEMENT vs. FOR EACH ROW
Using ORDER when Similar Triggers Exist
What is the Order of Precedents?
What is the Answer to this Math Question?
What is the Answer to this Math Question?
What is the Answer to this Math Question?
The SAMPLE Function and Syntax
A SAMPLE Example that asks for Multiple Samples
A SAMPLE Example with the SAMPLEID
A SAMPLE Example WITH REPLACEMENT
A SAMPLE Example with Four 10% Samples
A SAMPLE with Conditional Logic
Aggregates and A SAMPLE using a Derived Table
Using Random to SELECT a Percentage of Rows
Chapter 40 - Statistical Aggregate Functions
Another CORR Example so you can compare
Another COVAR_POP Example so you can Compare
Another REGR_INTERCEPT Example so you can compare
Another REGR_SLOPE Example so you can compare
No Having Clause vs. Use of HAVING
Explain Example – Full Table Scan
Explain Example – Unique Primary Index (UPI)
Explain Example – Non-Unique Primary Index (NUPI)
Explain Example – Unique Secondary Index (USI)
Explain Example – Redistributed to All-AMPs
Explain Example – Row Hash Match Scan
Explain Example – Duplicated on All-AMPs
Explain Example –Low Confidence
Explain Example – High Confidence
Explain Example – Product Join
Explain Terminology for Partitioned Primary Index Tables
Explain Example – From a Single Partition
Explain Example – From N Partitions
Explain Example – Partitions and Current_Date
Chapter 42 - Collect Statistics
The Teradata Parsing Engine (Optimizer) is Cost Based
The Purpose of Collect Statistics
When Teradata Collects Statistics, it creates a Histogram
The Interval of the Collect Statistics Histogram
What to COLLECT STATISTICS On?
How do you know if Statistics were collected on a Table?
A Huge Hint that No Statistics Have Been Collected
The Basic Syntax for COLLECT STATISTICS
COLLECT STATISTICS Examples for a better Understanding
The New Teradata V14 Way to Collect Statistics
Where Does Teradata Keep the Collected Statistics?
The Official Syntaxes for COLLECT STATISTICS
How to Recollect STATISTICS on a Table
Teradata Always Does a Random AMP Sample
Random Sample is kept in the Table Header in FSG Cache
How a Random AMP gets a Table Row count
Random AMP Estimates for NUSI Secondary Indexes
USI Random AMP Samples are Not Considered
There's No Random AMP Estimate for Non-Indexed Columns
Summary of the PE Plan if No Statistics Were Collected
Stale Statistics Detection and Extrapolation
Extrapolation for Future Dates
How to Copy a Table with Data and the Statistics?
COLLECT STATISTICS Directly From another Table
How to Copy a Table with NO Data and the Statistics?
When to COLLECT STATISTICS Using only a SAMPLE
Examples of COLLECT STATISTICS Using only a SAMPLE
Examples of COLLECT STATISTICS for V14
How to Collect Statistics on a PPI Table on the Partition
Teradata V12 and V13 Statistics Enhancements
Teradata V14 Statistics Enhancements
Teradata V14 Summary Statistics
Chapter 43 - Hashing Functions
The HASHROW Function in a real-world Example
The HASHBUCKET Function in a real-world Example
The HASHAMP Function in a real-world Example
A Great HASHAMP Function for Large Tables
A Real-World HASBAKHAMP Function Example
A Great way to see distribution for Primary and Fallback rows
Chapter 44 - BTEQ – Batch Teradata Query
BTEQ – Batch Teradata Query Tool
How to Logon to BTEQ in Interactive Mode
Running Queries in BTEQ in Interactive Mode
BTEQ Commands vs. BTEQ SQL Statements
WITH Command for a Grand Total
WITH and WITH BY Together for Subtotals and Grand Totals
How to Logon to BTEQ in a SCRIPT
Running Queries in BTEQ through a Batch Script
Running a BTEQ Batch Script through the Command Prompt
Running a BTEQ Batch Script through the Run Command
Using Nexus to Build Your BTEQ Scripts
Using Nexus to Build Your BTEQ Scripts
Using BTEQ Scripts to IMPORT Data
What Keywords Mean in a BTEQ Script
Creating a BTEQ IMPORT for a Comma Separated Value File
Four Great Examples/Ways to Run a Teradata BTEQ Script
BTEQ Export – Four types of Export Variations
Creating a BTEQ Export Script in Record Mode
Creating a BTEQ Export Script in Report Mode
The Appearance of Record Mode Vs Report Mode Data
Using Report Mode to Create a Comma Separated Report
Creating a BTEQ IMPORT for a Comma Separated Value File
Using Multiple Sessions in BTEQ
BTEQ Can Use Conditional Logic
Using a BTEQ Export and Setting a Limit In a UNIX System
Chapter 45 – Top SQL Commands Cheat Sheet
SELECT All Columns from a Table and Sort
Select Specific Columns and Limiting the Rows
Changing your Default Database
Select TOP Rows in a Rank Order
Getting a Sample Percentage of rows
Find Information about a Database
Find information about a Table
Performing a Join using ANSI Syntax
Using Date, Time and Timestamp
Using the System Calendar in a Query
Using an Access Lock in your SQL
CREATING a Volatile Table with a Primary Index
CREATING a Volatile Table that is Partitioned (PPI)
CREATING a Volatile Table that is deleted after the Query
Finding the Typical Rows per Value for specific column
Finding out how much Space you have
How much Space you have Per AMP
Finding Space Skew in Tables in a Database
Finding the Number of rows per AMP for a Column