Rant on Augmented Reality vs Virtual Reality

I've recently been doing a bunch of interviews on AR/VR around the internet, and I want to put my opinions here in my own blog.

First, when talking to a skeptic, its basically impossible to convince them otherwise. These are people who may have been burned by AR in the past and will only believe when they actually play it for themselves. In the famous words of Steve Jobs, "A lot of times, people don’t know what they want until you show it to them."

Second, we should not be asking whether virtual reality or augmented reality is better than the other. They are different. They have different strengths. They each have different killer applications. The question is, is augmented reality (when done right) fun? 'cause that is what really matters to games. Is it fun?

Third, I'd like to criticize a way of thinking that the only augmented reality that is good augmented reality is perfect augmented reality. This opinion is held erroneously by some prominent people in the games industry. Where the only good AR is where you can walk anywhere, use it in any condition, etc... If we followed this train of thought where we didn't work within limitations of technology to make great content, traditional gaming would have never made it past Pong. We would have been stuck thinking games would only work if they were all photo realistic and they worked with your schedule and you could take your games with you wherever you are. Obviously games are doing very well and they still are not photo realistic even today.

Fourth, Augmented Reality is nothing but gimmicks. While I agree that most AR games today are very uninspired and not creative enough, I strongly disagree that AR can only produce gimmicks. What is Mirror's Edge? What is Assassins Creed? What is Grand Theft Auto? These are all gimmicks, yet they make truck loads of money.

Fifth, will Augmented Reality displace VR or standard gaming? No. Just like mobile gaming will never kill PC or Console gaming. If that was going to happen it would have by now. I personally feel its more likely actually that mobile and standard gaming on a big screen TV will merge into one. There will always be room for deep emotional experiences that can be best experienced when played for more than 10 minutes at a time.

Sixth, the key to making great AR games that are fun and not boring gimmicks is to involve the world to a great extent and ideally involve other people.

So, can we make augmented reality fun? I've spoke with some incredibly creative people with ideas I could have never come up with. There are fun ideas out there for Augmented Reality, but you have to think inside the limitations box to come up with them. All it takes is a bit of creativity, and remembering what it is like to have the imagination of a child. AR is a new field a lot like the beginning of video games where you have to re-learn how to make things fun. Like a child we are learning to walk and that comes with bumps on the road. But like any child, they will grow up one day and those which were there from the beginning can grow with it.

In my spare time with some friends I am making some indie games for VR, AR and traditional games. Our first game is called Dragonfly. I'll post more about it later :)

Backing up your Data in the Cloud

Prerequisites: An Ubuntu Linux Box

Due to all the lightning around here my paranoia kicked in and I've decided to move my data into the cloud. The question was, how to do it at a reasonable cost? and also be reasonably certain that the people who host your data don't some day go out of business and you end up losing your data.

There are many options: http://en.wikipedia.org/wiki/Comparison_of_online_backup_services

Which to choose?

Dropbox seemed like the best choice in terms of company reliability.

Dropbox costs $10 per month for 50gb or $20 for 100gb.

This is not actually horrible, but has the problem of paying for gb you don't actually use.

Lets look at raw providers:

Rackspace CloudFiles: $0.15 * 50gb = $7.50 per month.

Amazon AWS S3 Standard: $0.125 * 50gb = $6.25 per month

Amazon AWS S3 Reduced: $0.093 * 50gb = $4.65 per month

Clearly Amazon is the winner here in terms of cost at less than 50% the cost of dropbox.

Setting up with CloudFiles:

Install cloudfuse: https://github.com/redbo/cloudfuse

Setting up with Amazon AWS S3:

Install s3fs: http://code.google.com/p/s3fs/

Setting up the common elements:

1. Set up a network share with Samba. https://help.ubuntu.com/11.04/serverguide/C/samba-fileserver.html
2. Install rsync via apt-get install rsync
3. Then open up "crontab -e" and setup a rsync copy into your fuse mount from the samba share.
   0 0 * * * rsync -va --size-only /srv/samba/share /media/cloudfiles

Voxels vs Displacement Mapping

Voxels on the left. Displacement mapping on the right.

What is being shown here is a pyroclastic sphere primitive. Link

This is a good example of the difference between a voxel technology, and a displacement mapping technology that the GPU manufacturers are pushing.

The DM tech is pretty obviously just pushing out parts and pulling in parts of the surface, making things look more like a wave function on a sphere.

The Voxel tech looks like a much more natural expression of the function.


Disclaimer: To be fair, both pictures are using voxels in the source article. However the right picture could easily have been accomplished with DM and does IMO represent the difference between the two approaches.

What a 128bit addressing space is useful for...

What if you had unlimited storage capacity and it was fully redundant... and what does this have to do with a 128bit addressing space?

To answer that question, you have to look into how to implement a P2P Cloud Storage solution.

To make a long story short, every file sector gets an address - a very big one. Some P2P services use up to 160bits. 128-bits is good enough for this new purpose though.

What if every file, every document ever made was in this P2P cloud storage. And it could be referred to as naturally as having a pointer in your code. The OS would page in part of this data from the internet on demand.

This is what I would think of as the ultimate computer storage solution -- blurring the line between computer and internet - to the point of being indistinguishable. This blur between internet and computer is where I believe computers are headed... I can't wait. :D

A shame 128-bit addressing is probably 20 years away... I'll be old by then (by my current standards anyway). It will be neat to watch the incremental progress towards this though as the years go by.

A few questions that keep crossing my mind is - If the internet could be applied to computing in general, to the extent of running something as simple as notepad.exe. How would it be done? How would it be secure? Is that possible with the internet of the future which has 10-100 times the bandwidth and 1/10th to 1/100th the ping? Which brings up more questions, such as what are the limits of internet related technologies? How fast is it advancing as to be able to make predictions about where it will be. etc...

Designing to make ATM Skimmers impractical

I was curious about how thieves make these things. Turns out you can buy ATM skimmers on online auction sites for $3000. They make them by manufacturer. So this got me thinking about what ATMs could do to make a skimmer impractical.

My first thought is to have 1000 different ATM front plates from each manufacturer. That would make most skimmers very expensive, but not quite impractical yet as they can just make a universal fit -- we can do better. If the shape of the card receptacle was easily identifiable by a human and able to match easily with a picture, then you could take advantage of the fact that a skimmer, no matter how complex never hides the display. You can use that to show a picture and have people manually verify the shape of the receptacle. If it is different, then there is a skimmer on top. While it would not eliminate skimming, it would make doing it incredibly expensive and unpractical to do for most thieves. The maker of the device would often be directly involved.

While this sounds all well and good, manufacturers would not like making 1000 different versions of their ATMs just to stop skimming. Implementation of that approach is unlikely and it doesn't solve the problem for millions of existing ATMs. Is there any other way to solve those problems?

Holographic stickers. If they printed out 10,000 different holographic stickers and put a different one right over the face plate, and then had people do the manual verification with a picture (for example a bunny, a squirrel, etc... easily recognizable to humans and you can have many hundreds if not thousands of variations). That would also serve the make impractical purpose for the most part. Its not as good as the former solution, but its a whole lot cheaper and can work on existing ATM machines with just a software upgrade.

At a minimum, you might even be able to not have the manual verification part and instead just have the holographic sticker with some special certification message. If it doesn't say ATM verified something or other, than its a fake. Having a sticker in the first place is a deterrent. Only risk without is somebody could rip off the sticker off the ATM and then use it on their skimmer. So that wouldn't be full proof.

Perhaps you could have a sequence of numbers on the sticker that you would have to enter before using the ATM. I would hate that, personally. It would work as well though and only work for that single ATM.

Know your SPU transposes - part 2

In this part of the SPU transposes series, we will cover 2 element transposes. Same format as last time.

AOS to SOA, 2 elements

4 input vectors of the format:

in1 = in1.x, in1.y, ?, ?
in2 = in2.x, in2.y, ?, ?
in3 = in3.x, in3.y, ?, ?
in4 = in4.x, in4.y, ?, ?


2 output vectors of the format:

out1 = in1.x, in2.x, in3.x, in4.x
out2 = in1.y, in2.y, in3.y, in4.y


I'll start with the simplest way to do it - all on the odd pipe. Then show some ways to do things differently to trade odd instructions for even instructions.

0 even, 4 odd, 3 shuffle masks, 10 cycles

Instructions	In English
shufb t1, in1, in2, s_AaBb	t1 = in1.x, in2.x, in1.y, in2.y
shufb t2, in3, in4, s_AaBb	t2 = in3.x, in4.x, in3.y, in4.y
shufb out1, t1, t2, s_ABab	out1 = in1.x, in2.x, in3.x, in4.x
shufb out2, t1, t2, s_CDcd	out2 = in1.y, in2.y, in3.y, in4.y

1 even, 3 odd, 4 shuffle masks, 9 cycles

Instructions	In English
shufb t1, in1, in2, s_AaBb	t1 = in1.x, in2.x, in1.y, in2.y
shufb t2, in3, in4, s_BbAa	t2 = in3.y, in4.y, in3.x, in4.x
selb out1, t2, t1, m_FF00	out1 = in1.x, in2.x, in3.x, in4.x
shufb out2, t1, t2, s_CDab	out2 = in1.y, in2.y, in3.y, in4.y

4 even, 2 odd, 4 shuffle masks, 10 cycles

Instructions	In English
selb t1, in1, in2, m_F000	t1 = in2.x, in1.y, ?, ?
shufb t2, in3, in4, s_aABb	t2 = in4.x, in3.x, in3.y, in4.y
shufb t3, t1, t2, s_BAba	t3 = in1.y, in2.x, in3.x, in4.x
selb out2, t2, in2, m_FF00	out2 = in2.x, in2.y, in3.y, in4.y
selb out2, out2, t3, m_F000	out2 = in1.y, in2.y, in3.y, in4.y
selb out1, t3, in1, m_F000	out1 = in1.x, in2.x, in3.x, in4.x

SOA to AOS, 2 elements

2 input vectors of the format:

in1 = in1.x, in2.x, in3.x, in4.x
in2 = in1.y, in2.y, in3.y, in4.y


4 output vectors of the format:

out1 = in1.x, in1.y, ?, ?
out2 = in2.x, in2.y, ?, ?
out3 = in3.x, in3.y, ?, ?
out4 = in4.x, in4.y, ?, ?


Again, I'll start with the simplest way to do it - all on the odd pipe. Then show some ways to do things differently to trade odd instructions for even instructions.

0 even, 4 odd, 4 shuffle masks, 7 cycles

Instructions	In English
shufb out1, in1, in2, s_Aa00	out1 = in1.x, in1.y, 0, 0
shufb out2, in1, in2, s_Bb00	out2 = in2.x, in2.y, 0, 0
shufb out3, in1, in2, s_Cc00	out3 = in3.x, in3.y, 0, 0
shufb out4, in1, in2, s_Dd00	out4 = in4.x, in4.y, 0, 0

0 even, 4 odd, 2 shuffle masks, 9 cycles

Instructions	In English
shufb out1, in1, in2, s_AaBb	out1 = in1.x, in1.y, in2.x, in2.y
shufb out3, in1, in2, s_CcDd	out3 = in3.x, in3.y, in4.x, in4.y
shlqbyi out2, out1, 8	out2 = in2.x, in2.y, 0, 0
shlqbyi out4, out3, 8	out4 = in4.x, in4.y, 0, 0

2 even, 3 odd, 4 masks, 7 cycles

Instructions	In English
shufb out2, in1, in2, s_Ba00	out2 = in2.x, in1.y, 0, 0
shufb out3, in1, in2, s_Cc00	out3 = in3.x, in3.y, 0, 0
shufb out4, in1, in2, s_Dd00	out4 = in4.x, in4.y, 0, 0
selb out1, in1, out2, m_0F00	out1 = in1.x, in1.y, 0, 0
selb out2, out2, in1, m_0F00	out2 = in2.x, in2.y, 0, 0

2 even, 3 odd, 3 masks, 8 cycles

Instructions	In English
shufb out2, in1, in2, s_BaCc	out2 = in2.x, in1.y, in3.x, in3.y
shufb out4, in1, in2, s_Dd00	out4 = in4.x, in4.y, 0, 0
shlqbyi out3, out2, 8	out3 = in3.x, in3.y, 0, 0
selb out1, in1, out2, m_0F00	out1 = in1.x, in1.y, 0, 0
selb out2, out2, in1, m_0F00	out2 = in2.x, in2.y, in3.x, in3.y

Next post...

... 3 elements

Know your SPU transposes

It has come to my attention that this is some needed and useful information to have. Too useful to keep to one's self. At Naughty Dog, some years back, Cort Stratton and I compiled a pretty comprehensive list of transposes. Its unbelievably handy to have on the fly as you need it. I've reconstructed the transposes as best I can and put it up here for your general use. Enjoy!

Introduction

There is more than one way to skin a cat. When converting from AOS to SOA and back there are many variations. How many instructions you have available to schedule in your even/odd pipes, how many spare registers you have to spend, and the latency of the combination of instructions used will dictate which you should use.

The goal is to first find all variations where you can trade even for odd or odd for even instructions -- and minimize the number of registers used in the process (including shuffle masks used).

Shuffle Masks
To specify shuffle masks, I'll use A-D,0 to specify the element 1 through 4 in the first parameter and a-d,0 to specify element 1 through 4 in the second parameter. '0' is special in that it means put a zero in the output for that element.

For example, s_ABab would take the first 2 elements in parameter 1 and the first 2 elements in parameter 2 and put them side by side into the output register.


Example - AOS to SOA, 1 element - 0 even, 3 odd, 1 shuffle mask, 9 cycles
Lets first consider the simple case of 4 input registers, where we are interested in combining the first element of each in(1-4) register into a single out register.

Instructions	In English
shufb t1, in1, in2, s_ACac	t1 = in1.x, ?, in2.x, ?
shufb t2, in3, in4, s_ACac	t2 = in3.x, ?, in4.x, ?
shufb out, t1, t2, s_ACac	out = in1.x, in2.x, in3.x, in4.x

Example - AOS to SOA, 1 element - 1 even, 2 odd, 2 shuffle masks, 7 cycles
This variation on the above splits up the even/odd pipe usage a bit at the cost of more masks.

Instructions	In English
shufb t1, in1, in2, s_Aa00	t1 = in1.x, in2.x, 0, 0
shufb t2, in3, in4, s_00Aa	t2 = 0, 0, in3.x, in4.x
or out, t1, t2	out = in1.x, in2.x, in3.x, in4.x

Example - SOA to AOS, 1 element - 0 even, 3 odd, 0 shuffle masks, 6 cycles
This example converts back from SOA to AOS. Still working on 1 element.

Instructions	In English
shlqbyi out2, in, 4	out2 = in.y, in.z, in.w, in.x
shlqbyi out3, in, 8	out3 = in.z, in.w, in.x, in.y
shlqbyi out4, in, 12	out4 = in.w, in.x, in.y, in.z

Contribute
Know a transpose that I didn't list? Find a better one? Post in the comments and I'll update the post.

Next post...
... will be on 2 element transposes.