Studio711.com – Ben Martens

Geek

Hard Drive Failures

I came home the other night and found out that I had a dead hard drive on my main file server. D’oh! That machine carries every one of our photos since we got a digital camera and a ton of the print photos from early in our childhood. It’s irreplaceable!

But, of course, I have multiple levels of backup so I knew my data was safe. It’s just a matter of getting it back to a healthy condition.

I decided to just let the drive sit there and wait for a replacement to arrive from Amazon. (4TB for $142!) Each file is stored on two physical drives so once I put the new drive in, it would automatically copy the files back onto the drive and I’d be all set.

Well, while I was waiting, the machine reported that a second drive had failed. It was the other one that I had purchased as the same time as the first drive so it’s not completely unreasonable that they failed together, but it still seemed unlikely. Looking through the SMART data on the drive, it looks like it got pretty hot in the case at one point so maybe that led to early demise (3 months after the 2 year warranty expired.) Now I had a mess on my hands and would be forced to pull out some backups.

I didn’t want to wait around so I drove to Best Buy and paid $40 extra for the same drive. Thankfully I was able to get the second failed drive to boot up again so the server was able to heal itself. When the new drive arrived from Amazon, I replaced that second drive because I just don’t trust it anymore. The machine now has four 4TB drives in it and all our files are safe.

I don’t know how you could read this site and not have heard me say it before, but BACK UP YOUR DATA! Hard drives only carry a one or two year warranty for a reason. Here’s the test for whether you are doing enough backups: if I walk into your house, take your computer and smash it with a sledgehammer, did you just lose photos, videos, documents, etc? If so, you’re not doing your backups correctly. Here’s the very quick and very economical solution: http://crashplan.com  Less than $200 will get you four years of worry free backups. Set it up once and forget about it until you need it.

Resetting Windows 8

If your computer is acting weird, slow or you suspect a virus, Windows 8 has two great new features that will help you get back to normal again.

  1. “Refresh” will keep your documents and pictures, but you’ll have to reinstall most of the programs on your computer.
  2. “Reset” will completely remove everything from your computer and put it back the way it was when you got it.

Both of these are just a few clicks away and they will guide you through the process. More information is available here: http://windows.microsoft.com/en-us/windows-8/restore-refresh-reset-pc

If you’re an uber geek, you can create custom reset images so that when you reset your PC, it can reset with a bunch of your regular apps pre-installed.

Sharing Big Files

So you need to share a big file or a bunch of files that add up to a lot. This problem has been around since time began and it’s often still easier to hand someone a physical piece of media like an SD card or a CD. But there are (free) ways to do it online and they aren’t terribly difficult. I can think of a dozen different ways to do it off the top of my head, but I’m going to pick one and yes, it’s a Microsoft solution. What did you expect?

  1. You probably already have a Microsoft account (hotmail.com, live.com, outlook.com, etc), but if you don’t go sign up for one.
  2. Visit OneDrive.com. You have a bunch of free space to store and share files.
  3. Create a folder for your files that you want to share.
  4. Upload the files into this folder.
  5. Go back to that folder, select it and then click Share.
  6. Choose “Get a link” from the left side. “View Only” should be selected by default on the right and that’s probably good.
  7. Click Create link.
  8. A link is generated and you can email that to the people you want to share it with. Anyone with that link will be able to get to the files you shared.

Cue the “The More You Know” music.

SprinRite in Hyper-V

You may remember a previous post about a product called SpinRite. It’s a hard drive maintenance and recovery tool, and it’s handy to have it in my bag of tricks. It has always been slightly annoying to use though because it requires me to dedicate a machine to it while it’s running and it can easily take a day (or even a week) to run.

Last week I had cause to run it again and after futzing around for a long time trying to get it to run on a spare laptop (it wouldn’t see the USB drive that was connected to the laptop), I started to wonder if I could get it to run in a virtual machine on my main desktop. SpinRite uses very low level commands to access the drive and I didn’t think that would work inside a VM, but why not try anyway?

Sure enough, it did work! Here are the steps I did:

  • Attach the USB hard drive dock to my desktop and insert the drive.
  • Power up the drive and wait for Disk Manager to recognize it.
  • Set the disk to Offline mode.
  • Create a new VM in Hyper-V (I’m running Windows 8.)
  • Use SpinRite.exe to create an ISO and set the VM to boot that ISO.

From that point, SpinRite could see the drive, and I didn’t care how long it took to run because it wasn’t blocking me from doing other work on the machine. Perfect! Theoretically I could even spin up multiple instances of the VM and point it to multiple drives to parallelize a big recovery job.

Power BI

I’ve written a couple times before about my Power BI project at work. The head of our group gave a presentation at the Worldwide Partner Conference that provides a nice overview of our future roadmap. To view it, go the WPC keynote page, click on “The Cloud for Modern Business” and then skip ahead to the 21 minute mark when James Phillips comes on stage.

Switching To Outlook.com

Last November, I posted that I was switching my email from GMail to Outlook.com. It didn’t affect anyone because it just meant that my @studio711.com email forwarded to a different site, but it was a pretty major change for me.

I did it in large part because I want to dogfood the solutions that our company provides in hopes of fairly representing them and offering feedback to the teams that wrote them. I thought it would be a bit of a downgrade, but wow, I’m really impressed. Outlook.com is a fantastic mail service. First of all, their junk mail detection is just as good as GMail. Where they really shine is their interface. Outlook.com loads faster and is subjectively easier to use, especially if you’re on a touch-enabled device. The web client looks and acts very similarly to the Windows 8 app so the continuity is a plus. I manage all my email in the desktop version of Outlook, but their web client and Windows 8 apps are so good, I’m thinking dropping the client version of Outlook.

This wasn’t the side-step (or even downgrade) that I expected. It’s pure win. If you’re frustrated with your email service or just looking for a change, give it a shot.

Weight Loss Data

Yesterday I wrote about the process of losing weight, but I only alluded to data sets. Let’s dig in! My data sources were the Fitbit API (for both number of steps and weight) and some weather history which I’ll explain later. This all came into through Power Query.

First of all, here is a chart showing my weight over time and then which days of the week. I usually gained weight on Sundays (our days to get together with family), Tuesdays (taco day in the café at work) and Fridays (the day we sometimes go out to eat.)

Next up are some charts showing the number of steps I took each day. The chart on the left shows how often I took a certain number of steps. The chart on the right shows the total number of steps each month. Note that we’re only halfway through June so that bar is shorter.

I fully expected to see a correlation between the number of steps I took on a given day and the amount of weight that I lost. Nope. Here’s a scatter plot showing no correlation. I think that walking is good for weight loss if you’re very overweight and you don’t move much. But there’s a point where walking is just too efficient to do much additional good.

I then started looking for other possible data correlation. Maybe the number of steps that I took was related to the temperature? Nope.

We’re in a wet part of the country so maybe the amount of rain we get in a day dictates how many steps I take? Not really. My really big days have happened when it doesn’t rain, but just because it’s dry doesn’t mean I’ll walk a lot.

In the end, I took all the various data points and ran them through Excels correlation algorithm. Nothing came out showing any real correlation. The biggest one was one of the charts you see above: the bigger the high temperature, the more steps I take, and even that was only a 0.48 correlation. That’s skewed quite a bit too because I’ve been doing a LOT more yard work lately and it has been warmer.

Even though I didn’t find a scientific way to lose weight, I did learn lots of things that AREN’T related and that’s interesting too!

Power BI World Cup

I’ve been posting lots of quick, little examples showing off pieces of our Power BI offering, but now I’ve got a huge one for you. Our team recently acquired access to a HUGE data set of statistics. With the World Cup starting up, we decided to use World Cup statistics for a great demo.

It’s running now at https://www.microsoft.com/en-us/powerBI/solutions/demo/qna/qna-demo-worldcup.aspx and I encourage you to check it out. Ask it any question about World Cup statistics and watch the magic unfold! The stats we used to build up the data model behind the scenes is super detailed so I think you’ll be surprised about what you can ask. Hopefully a bigger example like this makes it pretty obvious how useful Power BI could be operating over your own company’s data sets.

Heartbleed

The general media has picked up on a huge bug that rocked the tech world this week. I’m sure it’s partially because it has such a great name and logo. But what is Heartbleed and how does it affect you?

This isn’t a virus or malware that affects your computer. It’s a bug in some very critical code that is run by a lot of web servers. Basically, it gives out somewhat random chunks of computer memory to anyone who asks for it. That memory usually contains gibberish but sometimes it will contain things like user passwords or keys to the encryption of all the traffic going in and out of the server. The webcomic xkcd has a very simple explanation of the bug.

There are a bunch of things that need to happen to fix the hole. First the server admins need to patch their systems, get new encryption keys, and replace their SSL certificate. Once that happens, you can complete the final piece of the puzzle by changing your password. Some websites are being proactive and telling you when they’re ready for you to change your passwords. Others are being more quiet about it.

This whole thing has been *gasp* overhyped by the media. Yes, it’s a potentially big vulnerability but the odds of someone exploiting you are low, the patch is relatively quick and easy, and there’s evidence that nobody launched a widespread attack using this vulnerability before it was announced. That being said, updating your passwords is still a good idea. There are various lists around the internet that tell you which sites were affected, but this is one a pretty good resource. They are updating it regularly and telling you when it’s time to change your password (if you need to change your password at all.)

If you’re changing all these passwords but you aren’t using a password manager, consider getting started with something like LastPass.com. It’s free and easy. If you’re already a LastPass member, run their security checker tool. They’ll tell you which of your passwords need to be changed. LastPass was affected by Heartbleed too, but because they encrypt all of their traffic even underneath the SSL encryption, there’s no chance that any of the LastPass data was exploited.

So don’t fret about this too much, but do make sure you’re changing passwords as needed.

Movie Draft With Power Query

I know I’ve been making a lot of Power Query posts lately, but once you get into it, you start seeing data everywhere! The latest example is a movie draft that I participate in with some friends. I won’t explain what a movie draft is except to say that it’s like fantasy football for movies. We participate in a huge league run by Brian Brushwood and friends. They post a spreadsheet with all the data here: http://draft.diamondclub.tv/

I pulled those spreadsheets into Power Query, cleaned up the data, and voila, now we have an easy way to track just the people in our little group! You can see it at http://bit.ly/excelmovies We get interesting views like a leaderboard just for our group, and a list of the movies left for each one of us. I might add some more data views later, but these are the basics.

So if you’re in our movie group, how can you use it? You can use it passively by just visiting that bitly link every once in a while. I’ll update the data periodically for your enjoyment.

If you want to update the data yourself, add your own friends to the list of names to watch, and/or learn how the workbook was built, then you’ll need to do a little extra work.

  1. Install Office 2010 or 2013
  2. Install Power Query. If it fails then you don’t have the the right version of Excel. Sorry, you’ll have to stop here. (I continue to tell management that I think this is a bad decision.)
  3. Go to the bitly link and click Edit Workbook > Edit in Excel
  4. Save the file as a local copy.
  5. Click Data > Refresh All and wait a bit. When the status bar along the bottom of Excel completes then you should be seeing new data.
  6. You can see the Power Query queries that make up the workbook by clicking the Power Query ribbon and then clicking Workbook. You’ll see a side pane appear and you can double click any of those queries to start digging in.

Unfortunately I think Step 2 is going to stop a lot of you, but at least you can view the online link. And if Power Query doesn’t work with your version of Office, please feel free to complain in our forums!