Data Driven

In this Deep Dive, Frank and Andy delve into the depths of Data Integration and SQL Server Integration Service.

In this Data Point, Frank recounts how he has a new approach to troubleshooting WPF performance issues, or any issues for that matter.

Frank and Andy chat with Adam Hecktman, Director of Technology & Civic Innovation Chicago, about his work with data for the public good.  It was Adam who inspired Frank to get into data science.

Frank is in Reston tonight to speak at a new Meetup that focuses on AI and Machine Learning.

Frank and Andy talked about doing a Deep Dive show where they take a deep look into a particular data science technology, term, or methodology.  And now, they deliver! In this very first Deep Dive, Frank and Andy discuss the differences between Data Science and Data Engineering, where they overlap, where they differ, and why so many C-level execs can't seem to figure out the deltas. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes Frank's new courses are up at WintellectNow (01:30) David Goggins (03:00) Dive! Dive! Dive! It's a deep dive on Data Science vs. Data Engineering (06:00) "Clean data" means different things to different people. (09:30) "Shaping the data." (11:00) Our conversation with Buck Woody (12:30) Andy's screed on managing NULLs (14:00) Andy's screed on managing dupes (17:00) Frank, on aggregation and schema changes... (21:21) Attempted NoSQL definition (23:45) On MySQL... (25:00) Maybe "No" stands for "Not only" (26:45) "What sorcery is this?!" (28:30) Kevin Hazzard's article on Database Design if we started today (29:15) Andy's opinion: We're not using the SSD-ness of SSD's (31:30) "I don't know how much simpler you can get." - Andy (33:00) Denny Cherry's company: Denny Cherry and Associates (34:45) "... somewhere between useless and lying..." (35:45) Frank on HDFS (38:00) ClearDB wiped out 13 years of Frank's blog data, and we're still bothered by that. (40:30) sklearn (42:50) Correlation is not causation. (45:30) How to Lie with Statistics (45:45) Movie/TV Reference: Star Trek TNG (46:15) CNTK (Microsoft Cognitive Toolkit) (48:00) Frank, on selling ice cream... (49:25) On over-fitting (55:30) Training the model (56:30) Request for feedback! (57:30)

Yes, Andy and I are still alive and we're doing well. 2018 has started off like gangbusters for us both. Andy is going full bore in his consulting business and I've been big into Big Data, between delivering five online courses on Hadoop for WintellectNOW. There is a new episode in the hopper and it will be out soon. If you'd like to learn how to make the most of Azure Government, then check out these free courses I'm delivering in the DMV area. Reston - Feb. 26 - Feb. 28, 2018; 8:30am - 5:00pm Register here Chevy Chase - Mar. 12 - Mar. 14, 2018; 8:30am - 5:00pm Register here Elkridge - Mar. 26 - Mar. 28, 2018; 8:30am - 5:00pm Register here Reston - Apr. 2 - Apr. 4, 2018; 8:30am - 5:00pm Register here Reston - Apr. 23 - Apr. 25, 2018; 8:30am - 5:00pm Register here On that note, here's a little ear worm for you:

Today, I was in the Chevy Chase office at Microsoft and had the chance to bump into Brian Moran, who has recently joined Microsoft.

In this episode Frank and Andy celebrate a huge (yuge?) milestone, 100 uploads since launching in late May 2017. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes It's show #100! (01:30) On pop filters (03:30) On Azure.gov (04:30) Spiderman reference (05:00) Azure CLI (07:00) Regarding the Microsoft Dublin Datacenter Case (09:30) Data Law (Brad Smith, Microsoft) (12:00) Brent Ozar's post on GDPR (23:00) ClearDB deleted Frank's data (25:00) Andy is not selling in the EU (26:40) Soup nazi reference (30:20) Microsoft's German Data Centers (32:50) Frank's "aha" moment regarding Hadoop (34:50) Microsoft Azure HDInsight Big Data Analyst at edX (35:40) The Last SSIS Book You Read (37:15) Frank has a lot of certifications (43:30) On Dashboards (45:00) Regarding IIoT... (47:45) Databricks (50:00) Regardign the tuple (51:00) Data Science training is available at Wintellect Now (1:02:45) Khan Academy (1:04:15) Biml training is available at Biml Academy (1:05:30) Frank had a rough 2016, but he came back strong in 2017! (1:06:30) Frank is on a mission from God (1:08:15) Microsoft was founded 4 Apr 1975 (Frank was right and I was wrong) (1:09:10)

Noted science fiction author, Arthur C. Clarke once noted that "any sufficiently advanced technology is indistinguishable from magic." If you want to see this in action, then head no further to the nearest place you can play MagiQuest. Players are given an RFID enabled wand and go on a scavenger hunt to obtain "enchanted items." When players point the wand at various objects, these inanimate objects respond either by opening, lighting up or speaking. It looks exactly like magic.  

In this episode, Frank and Andy chat with Amanda Lange, technology evangelist at Microsoft, games journalist, and data aficionado. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes Frank is working on a Wintellect on Azure Gov (1:30) Amanda's site is Second Truth.com (99:00) The psychology of games (5:30) Movie reference: Back to the Future (6:30) How an Apple Watch or FitBit knows you're asleep (7:10) Game violence activates sections of the brain (but it's short-lived) (8:30) Andy lives in Farmville-not-the-game (10:30) Zynga and A/B testing (10:45) Amanda plays a lot of Overwatch these days (11:30) "Games as a Service" (12:10) Psychology in games Jeffrey "Lyte" Lin on Shaping Behavior in Online Games (13:30) Amanda writes for Tap Repeatedly (15:00) Amanda loves teaching people! (17:10) "I wasn't a data scientist until I was." (17:50) On privacy and data... (19:00) Berkeley's Data Science curriculum is online (19:40) Learn data science at Data 8 (22:15) GLaDOS is a character in the Portal games (25:00) The orchestral version of Still Alive (28:00) No arm-wrestling with Amanda (31:45) "We can learn anything." (32:45) Trapping a self-driving car using salt... (34:00) Ready Player One audio book (35:40) Ready Player One, the Movie (99:00) The Adventure Zone (37:50) Audible (get a free book!) has the Dragonlance series (39:25) Amanda tried out for American Idol (41:00) Amanda's on Twitter @second_truth (42:00)

In this episode, Frank and Andy catch up with Audrey Hammonds, the other half of the Data Chix duo. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes Frank's cold/allergies (1:00) Andy is now Enterprise Data & Analytics' Chief Data Engineer (2:00) Frank wants to be more like Buck Woody (3:00) Innovative Architects (3:50) Hurricane Irma disrupted Data Driven! (5:00) Data Chix (5:20) Palm Beach Tech Association (5:45) Audrey lives at the beach (8:00) Audrey escaped COBOL... (9:50) ... and learned Oracle in the Air Force (12:00) On COBOL... (13:00) Audrey studied Bio-Medical Engineering in college (14:30) On building toys for children with prosthetics... (15:15) "I'm right here!" - Andy (17:20) On Andy's phone calls... (17:35) "I've been trapped in here with me for decades, and I am not impressed." (21:45) On Women if Tech... (23:00) Being a woman in IT... "It's a double-edged sword" (25:20) Microsoft Flow (27:00) "If you don't like learning, this is a terrible field..." - Frank (28:15) We are constantly learning... (29:00) Weaponized hacking (30:00) Shoutout to the Frank and Andy show about Elon Musk (32:40) Data is the new oil (33:30) Audrey is putting PowerBI in SPACE! (36:00) Movie reference: Hackers (39:30) Book Reference: Wheel of Time (40:30) Book Reference: Paradox Bound (41:15) Book Reference: Ready Player One (42:00) Sci-fi television reference: Stargate (44:00) Sci-fi television reference: Battlestar Gallactica (44:30) Back to school for Audrey! (45:30) Randy Dyess' first sci-fi book: First Contact: Spider Wars: Book 1 (49:00) Mark Russinovich's book: Zero Day (50:00) "I don't always know what I'm doing." (53:00) "Be ready to fail many, many, many, many times before you get it right." (54:00) #SqlFamily shoutout (56:45)

Frank and Andy talk with Kira Wetzel about girls+data, running, Harry Potter, and the stream of consciousness. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes Frank's home improvement (2:15) Kira's LinkedIn profile (4:00) Girls and Data (4:30) Data Point: Girls and Data at SQL Saturday Charlotte (5:12) Tableau (6:00) "Say a Prayer" (9:30) Tourist-y stuff (12:00) "Quaint" (13:00) "Data found me." (13:30) TI-99, Q*bert, and BurgerTime (16:40) Girls and Data (18:45) "Try your vegetables" (22:00) Andy is right here... (22:15) Shoutout to SQL Cruise (Now Tech Outbound)! (26:15) Richmond SQL Saturday is 24 Mar 2018 (29:00) Running, sleeping, and eating (30:30) Girls on the Run (31:20) Technology is literally changing the world everywhere you look. (32:05) VR Vacations (33:55) A stealthy Microsoft Store visit... (35:45) Running calms the mind. (38:15) @girlsanddata (39:00) Stream of Consciousness and the Harry Potter question, again (41:00) Kira listens to Data Driven (42:45) Is "novitiate" the name of a young wizard? (44:00)

In this Data Point, Andy talks to the folks who organized and volunteered at the girls + data event at the recent SQL Saturday Charlotte. Also, Andy tries to get a family member billable.

Frank and Andy chat about the people and things Andy saw at this year's PASS Summit and Frank talks about his appearance on another data science podcast. Links Sponsor: Audible.com - Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics Notable Quotes Andys excellent PASS Summit 2017 Adventure (0:58) Frank responded well (6:20) Podcast Websites rock! (9:00) Frank got it working (11:50) Azure Data Science VM (14:20) "How much does that cost?" (15:15) "How big is that row?" (17:15) On delivering Microsoft demos... (18:05) I am Frank's hero! (20:30) Biml in the PASS Summit 2017 Day 1 Keynote. (20:50) "Stealth Biml..." (21:40) The Biml Book (22:00) Frank's Book! (23:50) Kevin Hazzard shout-out (26:00) Kevin's post about database designs Rimma Nehme on CosmosDB, Planet-Scale Applications, and Selling Door-to-Door (27:45) "There are smart people presenting in other rooms." (31:45) Eugene loves the show! (33:00) ...he's definitely a data scientist." (34:00) THE Frank La Vigne (35:30) The Data Driven Facebook page (36:00) The now-famous Dunkin Donuts Incident (36:45) The Economist Facebook Live (37:20) The Data Podcast by Rajib Bahar (37:45) Book reference: The Future of the Mind by Michio Kaku (39:30) Does Andy really exist? (41:41) The Data Driven Book.com (44:30) Frank spends quality time thinking on the beltway... (47:15) Pod-fade (49:00) On editing... (50:00) What does one call a wizard in training? (53:00)

Andy bumps into a fellow Virginian at the annual PASS Summit and they talk BIML.