Latest / DevQuestions with Tim Corey / 129 Which Database Type Should I Use For My App?

Transcript

129 Which Database Type Should I Use For My App? · DevQuestions with Tim Corey

• 0:00
  SPEAKER_01: Welcome to the Dev Questions Podcast with Tim Corey.
• 0:03
  SPEAKER_01: Join us each episode as we tackle the questions you are asking about a career in software development, understanding the industry, and new technology.
• 0:12
  SPEAKER_01: If you're just starting out or you want to grow stronger as a developer, this is the place to get your questions answered.
• 0:19
  SPEAKER_01: Now, here's your host, expert developer and online educator, Tim Corey.
• 0:25
  SPEAKER_02: Which database type should I use for my application?
• 0:28
  SPEAKER_02: This is a question I was asked recently on a suggestion site, and I thought it'd answer in today's episode of DevQuesti.
• 0:35
  SPEAKER_02: Now, let's get the answer out of the way right away, and then we'll talk through.
• 0:40
  SPEAKER_02: Okay.
• 0:40
  SPEAKER_02: So the answer is it depends.
• 0:42
  SPEAKER_02: Okay.
• 0:43
  SPEAKER_02: So that's the answer to pretty much any question you ask, but let's talk about the criteria, think through what's the best database type you should use for your application.
• 0:52
  SPEAKER_02: So the first question I want to ask is what's the purpose of a database?
• 0:58
  SPEAKER_02: All right.
• 0:58
  SPEAKER_02: So what is the purpose of any database that you have for any application?
• 1:03
  SPEAKER_02: Well, it's there to store your data, right?
• 1:06
  SPEAKER_02: It's there to hopefully give your data back to you quickly.
• 1:10
  SPEAKER_02: All right.
• 1:11
  SPEAKER_02: And then it's there to secure your data and it's there to protect your data.
• 1:17
  SPEAKER_02: All right.
• 1:17
  SPEAKER_02: So secure and protect, think of it this way.
• 1:20
  SPEAKER_02: Secure is like no one can access your database who shouldn't.
• 1:24
  SPEAKER_02: And the safety or security of your, I'm sorry, safety or protection of your database is like, is it backed up?
• 1:31
  SPEAKER_02: So if something happens to corrupt it, is it protected against that?
• 1:36
  SPEAKER_02: So is it, you know, your database is designed to protect your data as well as secure it.
• 1:42
  SPEAKER_02: Is there to store your data and is there to quickly give you back your data?
• 1:47
  SPEAKER_02: Those are the kind of the four big buckets that we're talking about when it comes to a database.
• 1:52
  SPEAKER_02: All right.
• 1:53
  SPEAKER_02: So here's an example for you.
• 1:55
  SPEAKER_02: Um, the IM TimCore database site, or I'm sorry, the IMTMQRI site has a database, I guess.
• 2:04
  SPEAKER_02: Uh we store data that is used to generate and populate the site.
• 2:08
  SPEAKER_02: And that's kind of a database.
• 2:10
  SPEAKER_02: But that database is a JSON file.
• 2:13
  SPEAKER_02: It's not SQL or NoSQL or any of those others.
• 2:17
  SPEAKER_02: The reason why is because it allows for the storage of all the data.
• 2:20
  SPEAKER_02: You can store data in a JSON file.
• 2:23
  SPEAKER_02: It's extremely fast to access.
• 2:25
  SPEAKER_02: It's as secure as it needs to be.
• 2:27
  SPEAKER_02: I mean, I don't care if you read my JSON file, go for it.
• 2:31
  SPEAKER_02: Read it all.
• 2:31
  SPEAKER_02: It doesn't matter because that's all public information.
• 2:35
  SPEAKER_02: And then it's protected by source control so that if it ever got corrupted, I just republished the latest build and we're good to go.
• 2:43
  SPEAKER_02: So when you think about your databases, don't say, oh, well, it must be SQL.
• 2:50
  SPEAKER_02: It must be, you know, some big expensive system, some complicated system.
• 2:54
  SPEAKER_02: A database could be as simple as a text file.
• 2:57
  SPEAKER_02: Now, do I recommend text file storage for your database needs?
• 3:03
  SPEAKER_02: Not usually.
• 3:04
  SPEAKER_02: I think that usually you want to kind of grow beyond that and use systems that better secure your data because usually you do care if people read your data.
• 3:15
  SPEAKER_02: And maybe you want to have a better backup system than just it's in source control.
• 3:21
  SPEAKER_02: Okay.
• 3:21
  SPEAKER_02: And the reason why my JSON works is because you don't write to it.
• 3:26
  SPEAKER_02: When you go to my website, you don't create anything that ends up getting put in that JSON file.
• 3:30
  SPEAKER_02: It's a read-only database.
• 3:32
  SPEAKER_02: The only time we change that data is when we physically go in there and make a change to the file and then commit that to source control.
• 3:40
  SPEAKER_02: So that's why it works for this situation, but not for every situation.
• 3:43
  SPEAKER_02: In fact, not for most situations.
• 3:45
  SPEAKER_02: But when you're thinking about databases, don't limit yourself.
• 3:48
  SPEAKER_02: Don't start with, okay, a database must mean some variant of SQL.
• 3:52
  SPEAKER_02: SQL, MySQL, SQLite, you know, down the list.
• 3:55
  SPEAKER_02: No, no, no, stop.
• 3:57
  SPEAKER_02: Back up.
• 3:58
  SPEAKER_02: And again, think about the goals of your data.
• 4:03
  SPEAKER_02: How is the database going to be used?
• 4:06
  SPEAKER_02: What is it needed for?
• 4:07
  SPEAKER_02: And so on.
• 4:09
  SPEAKER_02: So this is where we need to talk about the size of a database.
• 4:14
  SPEAKER_02: If you've got a large project, and by large, I mean you're expecting well over millions of records.
• 4:23
  SPEAKER_02: Millions.
• 4:25
  SPEAKER_02: In that case, you have less options.
• 4:27
  SPEAKER_02: Okay.
• 4:28
  SPEAKER_02: There's some things that just won't work.
• 4:29
  SPEAKER_02: For instance, uh SQLite.
• 4:32
  SPEAKER_02: That is will not work for millions of records.
• 4:35
  SPEAKER_02: It just shouldn't work.
• 4:36
  SPEAKER_02: It can, you don't want to do that.
• 4:39
  SPEAKER_02: Okay.
• 4:39
  SPEAKER_02: So you're kind of limited to a, you know, either SQL, a major SQL version, or a NoSQL version.
• 4:46
  SPEAKER_02: Okay.
• 4:46
  SPEAKER_02: And then it's just whichever flavor works best for you.
• 4:50
  SPEAKER_02: So we'll come back to that, but it really comes down to the skill of a team working on it and the previous databases used and the costs associated.
• 5:00
  SPEAKER_02: So if you're in an environment that already has 18 Microsoft SQL databases, and you say, what database should we choose for this project?
• 5:09
  SPEAKER_02: You're probably going to lean towards Microsoft SQL database because you already have a lot of the infrastructure, you already have a lot of experience, you already have a lot of the systems in place to help you build those databases.
• 5:21
  SPEAKER_02: And the cost associated will be pretty low.
• 5:24
  SPEAKER_02: And if you said, well, actually, we're going to try and use Oracle for this one, that's probably not a good call because you got a whole new database system and a whole new set of commands and all this other stuff.
• 5:35
  SPEAKER_02: You don't want to mix Oracle and Microsoft SQL.
• 5:38
  SPEAKER_02: You don't need to.
• 5:39
  SPEAKER_02: And you probably wouldn't go with a NoSQL database unless you had a good reason.
• 5:44
  SPEAKER_02: You'd want to stick with what you already have.
• 5:48
  SPEAKER_02: So there are times of change, but in a big situation, usually you end up relying on those criteria.
• 5:56
  SPEAKER_02: Now, for a small database, and by small, I mean less than a million records.
• 6:01
  SPEAKER_02: Okay?
• 6:02
  SPEAKER_02: So we're talking about databases that really can handle even a medium-sized business.
• 6:08
  SPEAKER_02: Because even a medium-sized business just doesn't have millions and millions of records, all right?
• 6:15
  SPEAKER_02: Usually.
• 6:16
  SPEAKER_02: So for a small database, there's lots of options.
• 6:21
  SPEAKER_02: And they're going to appear based upon what your needs are.
• 6:26
  SPEAKER_02: So let's talk through some questions you can ask.
• 6:29
  SPEAKER_02: Does it need to be portable?
• 6:31
  SPEAKER_02: Meaning, if you deploy an executable file to a client machine, you install it using MSI or something else, and it needs to work offline, you probably want a database next to that exe.
• 6:43
  SPEAKER_02: Well, that's a portable database.
• 6:45
  SPEAKER_02: You don't want to install Microsoft SQL Server, you know, SQL Express or something like that on their machine and have it all set up.
• 6:53
  SPEAKER_02: That's a little complicated for just a portable database.
• 6:56
  SPEAKER_02: So that's question number one.
• 6:59
  SPEAKER_02: Question number two, is this a single user or a multi-user database?
• 7:03
  SPEAKER_02: Meaning, if if I create a, let's say, a to-do list and maybe I even put it as a web app, but only I have access to it.
• 7:11
  SPEAKER_02: It's just for me, I'm not going to publish it because, my goodness, there's a bajillion to-do apps in the market.
• 7:17
  SPEAKER_02: So I just want for me, I want a couple of tweaks to it.
• 7:21
  SPEAKER_02: That's a single user database.
• 7:23
  SPEAKER_02: So that will be a different choice than a multi-user database.
• 7:28
  SPEAKER_02: You could potentially even still use SQLite or goodness, Microsoft Access.
• 7:34
  SPEAKER_02: It could work, even though you would not want to do that for a multi-user environment.
• 7:40
  SPEAKER_02: All right.
• 7:41
  SPEAKER_02: Number three, does it need to be secure?
• 7:42
  SPEAKER_02: Again, coming back to my JSON example.
• 7:45
  SPEAKER_02: My JSON did not need to be secure at all.
• 7:48
  SPEAKER_02: Does yours need to be secure and how secure?
• 7:50
  SPEAKER_02: So, what level of security you need to have as far as who can have access and what type of access and limitations.
• 7:58
  SPEAKER_02: For instance, uh, Microsoft SQL Server, you can say your login only has access to these three store procedures.
• 8:08
  SPEAKER_02: That's it.
• 8:09
  SPEAKER_02: That's all you can do.
• 8:10
  SPEAKER_02: Whereas this login over here can access all the store procedures, but no tables or views.
• 8:16
  SPEAKER_02: And yet the store procedures can call those tables or views.
• 8:19
  SPEAKER_02: Whereas this login can access tables, views, store procedures, all of them, but it cannot modify any structure of those tables, views, or store procedures.
• 8:31
  SPEAKER_02: And this one over here can do backups and restores, but can't reaccess the database.
• 8:36
  SPEAKER_02: So there's lots of different things you can do based upon the levels of security you want to set up inside a Microsoft SQL Server.
• 8:45
  SPEAKER_02: You cannot do the same thing with a SQLite database.
• 8:49
  SPEAKER_02: Okay?
• 8:49
  SPEAKER_02: So there's different levels depending on a SQLite database.
• 8:53
  SPEAKER_02: You can have a login in password that protects the database where you get in.
• 8:58
  SPEAKER_02: That's, you know, that's kind of the levels you can have.
• 9:01
  SPEAKER_02: So which one you choose is going to depend on what levels of security you need to have.
• 9:06
  SPEAKER_02: Now, number four, does this database need to be replicated?
• 9:10
  SPEAKER_02: This is one that until more recently, um SQL was not good at.
• 9:16
  SPEAKER_02: Okay, SQL has had replication for decades.
• 9:19
  SPEAKER_02: But uh I say Microsoft SQL, um, but it's not been easy.
• 9:25
  SPEAKER_02: And it's not it's been complicated and expensive and all the rest.
• 9:28
  SPEAKER_02: And then NoSQL comes along, and NoSQL like uh MongoDB or Cosmos DB, super simple to replicate.
• 9:35
  SPEAKER_02: Okay, you create a database and replicate across the globe, and boom, you're done.
• 9:39
  SPEAKER_02: So does it need to be replicated?
• 9:42
  SPEAKER_02: And how much replication?
• 9:44
  SPEAKER_02: Do you need to have uh read-write replicas, or do you want to have one database that's the read-write and a bunch of read-only replicas?
• 9:52
  SPEAKER_02: That changes things too.
• 9:54
  SPEAKER_02: So that's the fourth question to ask.
• 9:57
  SPEAKER_02: Number five, how fast does it need to be?
• 10:00
  SPEAKER_02: Now, when you're first starting off, everybody that is especially newer, but it's it's it's really a disease we all have.
• 10:09
  SPEAKER_02: And that is, I want to be as fast as Google, I want to be as big as Google, I want to have it have as much throughput as Google.
• 10:17
  SPEAKER_02: You're not Google.
• 10:18
  SPEAKER_02: You're just not.
• 10:20
  SPEAKER_02: So realistically, how fast does it need to be?
• 10:23
  SPEAKER_02: If it needs to be lightning fast, okay, that changes what things you can choose.
• 10:29
  SPEAKER_02: So here's some examples.
• 10:31
  SPEAKER_02: Okay, so if you have a single-user portable database need, okay, one user needs to be portable database, SQLite.
• 10:41
  SPEAKER_02: That's a good option.
• 10:42
  SPEAKER_02: Now, you could also look at a CSV file if that's you don't have to have protection.
• 10:46
  SPEAKER_02: And there's other options, but SQLite would probably be a good option.
• 10:50
  SPEAKER_02: Okay.
• 10:50
  SPEAKER_02: If you need a quick, cheap database that's replicated across the globe, MongoDB, maybe Cosmos DB, uh, those are very easy to replicate and they're very easy to start very, very small and very, very cheap.
• 11:05
  SPEAKER_02: All right.
• 11:05
  SPEAKER_02: If you need a small multi-user database that maybe you're already working with some SQL databases or have some knowledge of Microsoft SQL Server, Azure SQL, great place to start.
• 11:16
  SPEAKER_02: Uh,$5 a month, I believe it is, for the tiniest dev database that is super small but still works as a full SQL Server.
• 11:25
  SPEAKER_02: Five bucks a month.
• 11:26
  SPEAKER_02: Okay.
• 11:27
  SPEAKER_02: Maybe it's 10.
• 11:27
  SPEAKER_02: I think it's five.
• 11:28
  SPEAKER_02: Um, anyways, super small version for a small multi-user database.
• 11:34
  SPEAKER_02: If you need extremely fast databases that's used for caching, Redis.
• 11:41
  SPEAKER_02: Okay.
• 11:41
  SPEAKER_02: You might want to look at Redis because that's what they're designed for is for caching.
• 11:46
  SPEAKER_02: It's still a database, but it's designed for very, very quick lookups because that's what's most important is that super fast speed.
• 11:54
  SPEAKER_02: All right.
• 11:55
  SPEAKER_02: So different databases for different situations.
• 11:59
  SPEAKER_02: Go through that checklist of those questions and say what kind of fits in best.
• 12:05
  SPEAKER_02: Now, here's my recommendation.
• 12:08
  SPEAKER_02: And in order to use that list of questions that I gave you, you need to follow this recommendation.
• 12:13
  SPEAKER_02: And that is get to know the various database types.
• 12:16
  SPEAKER_02: Because if you don't know what's out there, then how can you make a decision on one versus the other?
• 12:23
  SPEAKER_02: And then even if you know what's out there, you need to know their strengths and weaknesses.
• 12:28
  SPEAKER_02: Because every database is different in its strengths and weaknesses.
• 12:33
  SPEAKER_02: All right.
• 12:34
  SPEAKER_02: If you don't know those, how do you compare the two?
• 12:37
  SPEAKER_02: There's a bajillion flavors of SQL.
• 12:40
  SPEAKER_02: Like I said, MySQL, NoS or SQL Lite, Microsoft SQL, Oracle.
• 12:46
  SPEAKER_02: These are all SQL type databases where you use a SQL command structure and it's a relational database and all the rest.
• 12:54
  SPEAKER_02: And so why would you choose one or the other?
• 12:56
  SPEAKER_02: You have to know its strengths and weaknesses.
• 12:59
  SPEAKER_02: Now, put a big emphasis when you're learning these database types on understanding both the SQL structure and the NoSQL structure.
• 13:08
  SPEAKER_02: Too often people say, you know, SQL relational database is the only way to go.
• 13:14
  SPEAKER_02: Really?
• 13:15
  SPEAKER_02: Because all your caching databases are all NoSQL databases.
• 13:20
  SPEAKER_02: So why are you saying that?
• 13:22
  SPEAKER_02: You don't want to cache your data in a Microsoft SQL Server.
• 13:25
  SPEAKER_02: That's just not the place to do it.
• 13:27
  SPEAKER_02: You want to cache it in a Reddit structure because that's a NoSQL structure.
• 13:32
  SPEAKER_02: And in fact, there's not just one NoSQL type, there's multiple.
• 13:37
  SPEAKER_02: Okay?
• 13:37
  SPEAKER_02: You have a graph database and you have the key value dictionary type pairing.
• 13:42
  SPEAKER_02: And you like there's so many different types of NoSQL databases.
• 13:46
  SPEAKER_02: You should know them all and how to use each one effectively.
• 13:51
  SPEAKER_02: Put emphasis on knowing both the SQL structure and the NoSQL structure.
• 13:55
  SPEAKER_02: Don't throw out tools.
• 13:58
  SPEAKER_02: Too often I hear people say, well, you know, this is the best tool, so therefore throw that one away.
• 14:05
  SPEAKER_02: Don't do that.
• 14:07
  SPEAKER_02: Put the tools in your toolbox.
• 14:09
  SPEAKER_02: Know when they're used most effectively.
• 14:12
  SPEAKER_02: Because doing that will allow you to make the best choice for your situation.
• 14:18
  SPEAKER_02: At the very beginning, I gave you the answer to this question.
• 14:21
  SPEAKER_02: And the answer was, it depends.
• 14:25
  SPEAKER_02: And if you say this tool is best, throws others out, then you're saying, no, Tim, you're wrong.
• 14:32
  SPEAKER_02: It doesn't depend.
• 14:33
  SPEAKER_02: This is the tool.
• 14:35
  SPEAKER_02: And that's just not correct.
• 14:37
  SPEAKER_02: There's a reason we have multiple different types, because different database types fit different situations better.
• 14:45
  SPEAKER_02: All right.
• 14:46
  SPEAKER_02: So once you pick your database, once you say, I've I've narrowed down based upon my knowledge, and based upon the pros and cons and the strengths and weaknesses and the costs and all the rest, I've decided this is the database of choice.
• 15:01
  SPEAKER_02: Great.
• 15:02
  SPEAKER_02: Now, really get to know it.
• 15:06
  SPEAKER_02: Okay?
• 15:07
  SPEAKER_02: Really dive deep into that database.
• 15:10
  SPEAKER_02: Don't just stop at the surface level.
• 15:13
  SPEAKER_02: Too often I see people say, well, you know, here's my pet peeve.
• 15:17
  SPEAKER_02: I use Entity Frameworks, so I don't need to know about SQL.
• 15:21
  SPEAKER_02: That's just a bad idea.
• 15:24
  SPEAKER_02: Because you need to know how to get the most out of your database, how to use it well, how to secure your data properly, how to properly back up your database so that it's protected.
• 15:37
  SPEAKER_02: You're protecting that data, how to restore that database properly, how to manage who has access to it and make sure that it's locked down as much as possible, how to get the most performance out of it possible.
• 15:49
  SPEAKER_02: I've seen people complain about databases being slow when they're using really, really bad queries.
• 15:55
  SPEAKER_02: Well, write a better query.
• 15:57
  SPEAKER_02: But in order to do that, you have to know how to write a better query.
• 16:01
  SPEAKER_02: So go deep into understanding your database that you're using.
• 16:05
  SPEAKER_02: Don't just stop at the surface level and say, I put data in, I get data out, we're good.
• 16:11
  SPEAKER_02: Okay?
• 16:11
  SPEAKER_02: Know it better than that.
• 16:13
  SPEAKER_02: All right.
• 16:13
  SPEAKER_02: So that's my answer to the question: which database should I choose?
• 16:17
  SPEAKER_02: It depends, but there's the criteria for choosing and evaluating which database works best for you.
• 16:24
  SPEAKER_02: A quick example here: I have a C sharp master course where I take you from knowing nothing to being a C sharp developer who can get a job as at least a junior level developer, if not higher.
• 16:36
  SPEAKER_02: Well, in there I have a complete section on databases.
• 16:41
  SPEAKER_02: And we don't just choose one database type.
• 16:44
  SPEAKER_02: We go through SQL, Microsoft SQL, SQL Lite, or MySQL, MySQL.
• 16:52
  SPEAKER_02: We go through using both Dapr and Entity Framework.
• 16:56
  SPEAKER_02: Yeah, I know.
• 16:57
  SPEAKER_02: We also use NoSQL like MongoDB and Cosmos DB.
• 17:01
  SPEAKER_02: We also look at Link.
• 17:02
  SPEAKER_02: We also look at a lot of different things to make sure you understand how to access data properly, how to be the best at accessing that data so that you understand I have 18 different tools.
• 17:19
  SPEAKER_02: I have 18 different sizes of flathead screwdriver.
• 17:23
  SPEAKER_02: Why?
• 17:24
  SPEAKER_02: Because different screws have different thicknesses, and I need the right screwdriver for the job.
• 17:30
  SPEAKER_02: Okay.
• 17:30
  SPEAKER_02: Or I need to have the right whatever other tool for this job.
• 17:34
  SPEAKER_02: So I go, I spend a lot of time in there because it's important to not just say SQL Server.
• 17:41
  SPEAKER_02: It's it's the one.
• 17:42
  SPEAKER_02: Microsoft SQL Server, it works great with C Sharp, and it does.
• 17:45
  SPEAKER_02: So therefore, that's the solution to every problem.
• 17:48
  SPEAKER_02: It's not.
• 17:49
  SPEAKER_02: Okay?
• 17:50
  SPEAKER_02: Make the right choice that works for you.
• 17:52
  SPEAKER_02: Okay.
• 17:52
  SPEAKER_02: Hope I answered your question.
• 17:54
  SPEAKER_02: Thanks for listening.
• 17:54
  SPEAKER_02: And as always, I am Tim Corey.
• 17:56
  SPEAKER_00: Thank you for joining us for this episode of Dev Questions.
• 17:59
  SPEAKER_00: Tim is committed to making it easier for you to become a developer.
• 18:03
  SPEAKER_00: If you would like to help make more content like this possible, please like, subscribe, rate, and share Dev Questions.
• 18:10
  SPEAKER_00: You can also send your questions to questions at IamTimCorey.com.
• 18:15
  SPEAKER_00: Until next time, remember, you are too smart and your time too valuable to waste it making all the mistakes Tim did.
• 18:22
  SPEAKER_00: When you're ready to learn to think and code like a professional developer, head over to IamtimCorey.com and enroll in a course.