Matterport Talkie Tour -- Feedback Wanted2943
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
| I'm working on a few Matterport projects. I wanted to share this because I think it's rather charming and fun. http://www.matterapps.com/talkie/ This is sort of the tip of the iceberg on something I'm working on ... Tested on Chrome and Firefox -- different voice on both... better on Chrome. Does not work on Microsoft EDGE. Be sure to look at the plant in the bathroom, the towel rack in the bathtub, the pantry in the laundry room... and walk to the end of the kitchen then jump over the counter to the next pano. And if you guys remember Showcase v1.0 -- you'll recognize the floorplan icon on the bottom left of the screen. I miss it  |
||
| Post 1 • IP flag post | ||
 TosoliniProductions Bellevue, Washington |
Tosolini private msg quote post Address this user | |
| Awesome! You are adding a new dimension to these tours. Well done! BTW, how do you trigger an external action by navigating to a specific spot? It really opens up a lot of opportunities |
||
| Post 2 • IP flag post | ||
|
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
| @Tosolini Thanks! I'm using very simple code injection to add functionality to Matterport Showcase that doesn't exist -- and I thought that adding voice over would be fun. I'm going to brainstorm how I can turn this into something useful that others can access. There are a lot of different directions to go in. My biggest concern would be making grand promises and then Matterport to shut it down So for the time being, it's certainly a proof of concept of what a sanctioned javascript API would be able to accomplish. |
||
| Post 3 • IP flag post | ||
|
Naz private msg quote post Address this user | |
| @Metroplex360 Awesome work. You are a legend. | ||
| Post 4 • IP flag post | ||
|
|
malfie private msg quote post Address this user | |
| Another truly gamechanger from @Metroplex360! Great job. This is a feature I can easily see people pay extra for. Now we only need an easy tool for the realtor to input the different bits of 'speech' on different types of locations. I peeked a little bit at your code, and I don't think it's that difficult to make a tool (or perhaps this is a little bit more of the iceberg you are working on). I'm not a developer, I just know my way around code a bit ;-) Keep it up, I'm a fan! |
||
| Post 5 • IP flag post | ||
|
GarySnyder private msg quote post Address this user | |
Well done @Metroplex360 |
||
| Post 6 • IP flag post | ||
|
APN private msg quote post Address this user | |
| Amazing @Metroplex360 | ||
| Post 7 • IP flag post | ||
|
PedroAvilez private msg quote post Address this user | |
| Very nice @Metroplex360 | ||
| Post 8 • IP flag post | ||
|
srennick private msg quote post Address this user | |
| @Metroplex360 so cool. So awesome how you keep stretching the capabilities of the Matterport experience. I think something like this adds so much value to the model. My clients would love it. | ||
| Post 9 • IP flag post | ||
|
3Dwalkmethru private msg quote post Address this user | |
| @Metroplex360 great concept .. Question: Will it be able to work with human voice as well? |
||
| Post 10 • IP flag post | ||
|
lisahinson private msg quote post Address this user | |
| Super! | ||
| Post 11 • IP flag post | ||
|
jfantin private msg quote post Address this user | |
| It is an interesting feature although I am not completely sure how much value it adds to a model. But what it is truly a game changer is the possibility of working with a tour and adding different things. Well done @metroplex!!! Maybe it won´t be words, but something else...we just have to wait until you surprise us with his inventive. There is a say here, and I think it is also said around the world: "an image is worth a thousand words". So perhaps adding words is not per se a game changer. A voice sustitute for mattertags? maybe, but mattertags are not invasive and you pop them up if you want them and only those you want it. On @malfie comment " I can easily see people pay extra for." I wouldn't bet on it. It is difficult to sell Matterport as it is, I cannot imagine charging more money on top of the current prices...but maybe I am wrong. |
||
| Post 12 • IP flag post | ||
|
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
| @jfantin All valid points. That's why I am getting feedback. Very curious to hear what people think and see their ideas. @3Dwalkmethru This is the WebSpeech API ( LINK) ... which means that the ability to synthesize the voice is instant -- no downloads necessary ... however, the sky is the limit on what is possible if one can perform actions on events... I may look into that. |
||
| Post 13 • IP flag post | ||
|
|
jfantin private msg quote post Address this user | |
| Exactly. What it is disruptive here is the idea of performing actions on events, and this is what opens up thousands of possibilities. Let's not think for a moment on real estate models, and think in other uses for Matterport. What about a game for children built on a castle or an old house? Think of a "treasure hunt" where you can get oral clues as you walk along the house...I don´t know, just throwing ideas. If insead of synthetic voices you could insert real voices then the experience could be awesome. |
||
| Post 14 • IP flag post | ||
|
|
srennick private msg quote post Address this user | |
| @jfantin I have a friend who's working on that very thing. Loves the idea of being able to provide a 3-D capture of the space for children's scavenger hunts…in particular for kids that are participating in a group activity but can't get around the space like other kids can. So many directions to go with what Matterport has provided. | ||
| Post 15 • IP flag post | ||
 WGAN ForumFounder & WGAN-TV Podcast Host Atlanta, Georgia |
DanSmigrod private msg quote post Address this user | |
| @Metroplex360 We have a Matterport scan of a museum coming up. While we were planning to use MatterTags for each piece of art, it would be nice to have the option to have the curator of the museum speak the story. Dan |
||
| Post 16 • IP flag post | ||
|
CDM private msg quote post Address this user | |
| @metroplex Great stuff! what about a matter tag that starts a music file? I am not a programmer and have been thinking of was to make it open another window and auto play music. Love the voice over with trigger point, it would be another great up charge to keep revenue increasing for scans. The VR is gone be a nice upcharge, this would add to the profits. Voice clips I think could have a nice interface to add them to a scan point. The more options to sell in the higher the price tag! Thanks for pushing Matterport. I think the more they get pushed the faster they work on adding new things that we all know the system will eventually do. Chris |
||
| Post 17 • IP flag post | ||
|
vantasy private msg quote post Address this user | |
| It is awesome, it will be great if we can adding music file into model. | ||
| Post 18 • IP flag post | ||
|
|
UserName private msg quote post Address this user | |
| Very interesting. I've seen other narrated tours but this one's in a Matterport model. What would happen if the audio clips were funny? Comedy still engages Internet users. They would not only get a VR tour but entertainment as well. You'd also have a product that I don't think exists. Some realtors make entertaining videos, but nobody's done this with VR tours. Overlay a temporary kitten at the gaze point, and you might have something that Internet users tweet around -- especially if the audio clips kept changing every time you took a tour. I've seen VR tours where the JS overlays a div on top of the display frame when a user moved to a particular point. CDM's music idea could also make a tour more entertainment. And then there's sound effects. I'm imagining a live Halloween Haunted House model that's an adventure more than a model. I could see someone Tweeting, "Check out the fireplace at this house. Hilarious" Since you can bookmark a specific location in a model, you can send someone a link that takes them to that point. |
||
| Post 19 • IP flag post | ||
|
Helen private msg quote post Address this user | |
| Your creativity astounds me, you are definitely a way outside of the box thinker! | ||
| Post 20 • IP flag post | ||
|
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
Quote:Originally Posted by UserName Hey, my tour was hilarious. There are hidden jokes in it  |
||
| Post 21 • IP flag post | ||
Regina, Saskatchewan Canada |
Queen_City_3D private msg quote post Address this user | |
| @Metroplex360 Brilliant! | ||
| Post 22 • IP flag post | ||
Belfast, United Kingdom |
3dshowcaseuk private msg quote post Address this user | |
| I think this is fantastic and as Jfantin says it has more uses in other sectors rather than real estate, museum, hotels, conference centres etc. | ||
| Post 23 • IP flag post | ||
|
|
UserName private msg quote post Address this user | |
| it's a bad pun but "walkie talkie" came to mind. You walk, it talks. | ||
| Post 24 • IP flag post | ||
|
Viewing private msg quote post Address this user | |
| @Metroplex360 I have no idea why Matterport haven't acquired your employment as some of your ideas are mind-bogglingly awesome. And then to implement the ideas and make them work is another level. Could you get the location's audio to fade or increase as you get closer or further away? E.g. you get near the music room and the volume increases as you approach it and fades as you leave the room? I could see a few uses for this, especially enticing people towards a certain area of the building via faint audio/music that grows louder as you near it. Kind of like a 'hotter' 'colder' game I used to play as a lad. |
||
| Post 25 • IP flag post | ||
|
|
UserName private msg quote post Address this user | |
| That hotter and colder thing sounds fun and useful. @Metroplex360 - You might test Google's OMNITONE experiment. They're trying to bring 3D surround sound to WebVR. When you visit this page, wait a few seconds and a 360 video will load. Various musicians will wander around a hall. As you rotate the video with your mouse, you'll be able to track everyone by their sounds. For instance, near the video's beginning, a singer on the right side of your hall may sing while a guitar player with loud footsteps walks in from the left. You'll hear both of them just as if you were there. As you rotate the hall, all sounds change appropriately, ie, if the musicians are behind you, you should be able to tell. You probably have to wear headphones to experience this and use Chrome also since that may have a higher probability of working. Here's an article about OMNITONE. If Matterport models could contain animations, like fireplaces and babbling outdoor fountains imagine the fun. |
||
| Post 26 • IP flag post | ||
|
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
| @Baxter I have no idea why Matterport haven't already released a Javascript API to allow us to write interesting extensions like the 'Talkie Tour'. Now as far as getting the location's audio to face or increase... that's quite complex. First, with the 'talkie', let's create a scenario where we had a Matterport Tour of a robot factory full of talking robots. When one runs away from a talking robot, I could indeed have the volume decrease with distance. I have the ability to create events based on the panorama, the pan, and the position within the model. In addition, events can be added when swapping view modes (if you note in my demo, there are voice events for dollhouse and floorplan modes). So in theory, the tour would capture the location within the mesh at the time the sound starts and augment volume based on one's position. In my published proof-of-concept, this wouldn't make much sense though @Baxter / @UserName - Where I'm a bit stuck on this idea -- especially on a 3D Surround Sound concept - is that a Matterport Tour is not a video 360. It would make sense if there's motion to have dynamic sound. Even simply having sound that trails off from the theoretical 'robots' in the robot factory example wouldn't be too useful in the real world -- more of a neat tech example, right? |
||
| Post 27 • IP flag post | ||
|
Olivius private msg quote post Address this user | |
| Hi @Metroplex360, I've just recheck your talkie tour and i've seen new stuff very very interesting as the div video and all the amazon links. Is it still possible to do with last matterport changes ? Or all the stuff you inject in the JavaScript are not available anymore. I'll be really please if you can give us an hint on how to create The same kind of proof of concept I've seen your source and the way you do It but was not able to replicate it. For info I use a different js library for voice speech including also voice recognition I help to debug to integrate it in a domotique platform (jeedom), and that could introduce a whole new way to navigate and in a virtual tour... for example say "show me the master bedroom" , "dollhouse view" clickable text This library works great on google chrome on pc mac and even android. Check the examples and the source and I'm sure you will see the potential  If i can test some stuff and help debug for you let me know |
||
| Post 28 • IP flag post | ||
|
Frisco, Texas |
Metroplex360 private msg quote post Address this user | |
| @Olivius sounds like a cool idea! Shoot me a pm. This project is intended as a proof of concept for the time being as there are potential hurdles associated with it. If I had Matterport's blessing, it would allow me the peace of mind to devote more time into shaping this into a community tool. This is presently made possible by running the tour via a local proxy and injecting code. I believe it doesn't violate TOS, but if matterport would like to claim it does, there are many angles they could take. I built this largely as a proof of concept to advocate putting more priority on a public api. |
||
| Post 29 • IP flag post | ||
|
|
Viewing private msg quote post Address this user | |
| @Olivius @Metroplex360 Talkie is the best thing since sliced bread and it's the future of Matterport. The possibilities are potentially limitless. Please release your API Matterport. Please, please super please with an SDK cherry on top  |
||
| Post 30 • IP flag post | ||
This topic is archived. Start new topic?