March 5, 2006

Coolest AJAX UI ever built!

Posted in innovate this!, Innovation, Product Development at 12:13 pm by scottmaxwell

With the recent snow in Boston (some of which is still around) I found the time to build the coolest AJAX UI that I have ever seen. Some of the characteristics of it:

  • Built 100% with off-the shelf AJAX components (7 in total)
  • Each component is fully encapsulated with an off-the-shelf wrapper
  • The interfaces between the components were so simple, I only needed to literally place each component (they were designed to be stackable).
  • The total cost of the components was $8.41 (U.S.) and I had a few components, included in that price, that turned out not to be necessary to use.
  • The only real trick to the entire exercise was getting the foundation stable enough to stack the components on top. I found that the initial foundation caused the components to crash, but with a few minutes of configuration adjustments the foundation was completely stable.
  • I tweaked the alignment of the stack to try to get to optimal alignment. I could probably have spent a little more time perfecting the alignment, but the UI still looks very good.

Take a look at the UI here. It is extremely intuitive and you do not have to be familiar with AJAX to get an appreciation for the construction technique.

I think that you will agree that this is the coolest AJAX UI ever!

February 5, 2006

The Next Computing Platform, The Wearable Internet is Closer Than You Think!

Posted in innovate this!, Innovation at 11:42 am by scottmaxwell

Recently, I wrote a post on the issue of the computer screen size as my personal issue with the truly portable device formats. Today’s Boston Globe article “The next big thing: Tiny screens, way up close” made me connect the dots on a few developments that I believe will give us a new portable computing platform, the Wearable Internet, (at least for early adopters) within the next 2-3 years (perhaps sooner, as it is hard to give a point estimate).

Much has been written and discussed about wearable computers over the years (example here and some additional resources here), but until now it has been just a futuristic vision for me. The Globe article, along with some other recent experiences, has made it clear that some combination of companies will be coming out with a practical set of devices sooner than I would have previously thought.

The Components for the Wearable Internet…

From my vantage point, there are several components necessary for a truly wearable experience. Each is getting VERY close or is already here:

1. The wearable screen. I have investigated wearable screens a few times over the last 25 years, and each time have come to the conclusion that there is more work to do (the big issues are price, size, quality, and battery life). The Globe article made me realize that the advances in wearable screens are accelerating and that the move toward portable video (ala the Video Ipod) might help the innovators put more resources against getting there more quickly. (this is probably the single component that will determine how quickly the new platform becomes truly practical, at least for me). My sense is that I still will need a wired connection to the central processor for video, but, even if this is right, it is not an issue with making a practical wearable computer.

2. The wireless keyboard. I have had a wireless keyboard for several years now, so this is really a no brainer. My new Xbox 360 wireless controls also has reminded me that the wireless input device technology has no issues at this point. It seems to me that some combination of “thumb keyboards” and full size keyboards would be useful for several situations, although there are lots of possibly great developments that could lead to much better finger/hand input for the wearable computer. Allowing the Treo, Blackberry, or other PDA keyboard to communicate directly with the central processor would be useful.

3. The central processor. Again, already here in a lot of ways, although the power of the truly wearable computers is not to the level I would like (I don’t want a PDA connected to the Internet, but rather a fully functional laptop, perhaps without the DVD slot). I built a wearable computer for a master’s thesis 21 years ago with the then available technology, so there is no doubt in my mind that a manufacturer can take the current chip sets and put them into a smaller battery powered bundle (without a keyboard or screen…similar to the Mac Mini in concept). Worst case, I can use my laptop in my briefcase as the central processor, although it would not give me the geographic range that I am looking for longer term.

4. The Internet connection. I use a card in my laptop with a Verizon Internet service that costs about $60 per month for unlimited use. It works beautifully (Brad Feld and Robert Scoble have had similar experiences, Robert with Cingular). Manufacturers are already working on building the cards into the computers, so again no issues with easily getting a combination of Verizon and Wifi connection, depending on location (perhaps Wimax will come along as well, but the technology is here already and works great).

Other peripheral technologies such as location, voice I/O, and image capture are equally well developed, so there do not seem to be any issues standing in the way of this platform becoming a reality other than some straightforward engineering and getting to a set of components that are relatively easy to mix together to create the wearable bundle that most suits the user.

The evolution…

As with anything, there are many possible paths to getting here. One practical path is that the wearable screens continue to evolve (pushed by video players) and eventually people like me start hooking them along with a bluetooth keyboard and Verizon internet service into our laptops (the laptops then stay in the briefcase). Then, one of the laptop manufacturers (Apple, perhaps) comes out with a “wearable laptop” that is essentially a laptop without the screen, keyboard, or DVD slot, and includes a built in Verizon card)…it only takes off from there!

An alternative (parallel?) path is for users to start connecting the wearable screens to their PDAs and/or Ipods and for the PDAs to continue to evolve in processing power and internet connectivity until the laptops and PDAs converge into one.

Lots of other possible paths, but these two seem the most logical to me, at least at this point.

What are you going to do about it?

Ed Sim reminded us recently that “A great hockey player plays where the puck is going to be.” If this is where the platform is going to be, where are you going to be?

January 16, 2006

Search Tech Opportunities- Summary

Posted in innovate this!, Innovation at 8:28 pm by scottmaxwell

This is a summary of my series on Opening up the Search Tech Chain. The major point is that opening up the search technology model will have some great effects on all of the possible innovations around the model. The post the opening of the search tech chain discusses my argument for the opening up of the tech value chain and links to some other bloggers thoughts and resources on OpenSearch and the opening of the Alexa A9 search engine platform for others to innovate on.

Just so that I am clear on the abundance of innovation opportunities related to search, I have several posts that describe some opportunities for innovators. The ideas overall can be applied to text, images, audio, or video, each of which has its own issues and opportunities.
The posts:

  1. Every site needs to expose its APIs. Open APIs would be a huge opportunity to improve search, even with today’s search technologies.
  2. Lots of innovation potential in micropayments. While the ecosystem could get started without a micropayments infrastructure, these issues will need to get worked out.
  3. Mashups will be a lot more interesting with the new APIs. In my view, the mashups for the end users are the most exciting innovations (but probably not the most difficult). I lay out my thoughts on the potential for mashups in this post.
  4. Help me find what I am looking for. The matching of search intent to search results works okay today, but there are lots of improvement opportunities.
  5. Some thoughts on improving tagging. The social tagging sites have changed my use of the internet in tremendous ways. I point out some of the improvements to the tagging that I would like to see in this post.
  6. Put more features in feature vectors. We need to move beyond exact word search into many new approaches to finding what we are looking for. The posts start getting a little more technical here with the ideas on creating and exposing larger feature vectors.
  7. Machine Learning as a Web Service. Machine learning is one of developments on the internet that will change things dramatically for the users (and will offer some great economic results to the winners). This post outlines some thoughts on how it might be achieved as a web service.
  8. Machine Extraction. Finally, turning unstructured unlinked data into structured and linked data is unbelieveably difficult but very powerful stuff. This post gives an example and outlines some other rough thoughts on the topic.

I am sure that I have missed lots of opportunities for innovation in search, but this list is still very long and hopefully demonstrates the point that there is a lot to do! If I have any other ideas worth posting, I will post them and link to them here. Please also comment if there are other ideas or resources that are valuable to this list.

Search Tech Opportunities- Improvement #8: Machine Extraction

Posted in innovate this!, Innovation at 7:49 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the eighth opportunity that I see is with machine extraction and, even better, “linking” material from machine extraction. While this is really a subset of machine learning, the concept is different enough to discuss separately. The basic idea is how can you extract information from the web and put it into a more structured and, more importantly, accurate form. Then, how can you infer the relationships between the data elements that you have extracted.

A good example of a company related to this field is zoom info. Their tag line is “the search engine for discovering people, companies, and relationships.” I typed my name in to see what they had on me, and the list of information that they were able to extract and put together was very complete (I saw one error, as they matched me with an Insight Ventures that has a confusingly similar name to my firm. Hard to take that away from them, however). Pretty impressive stuff!

It seems to me that machine extraction and building relationships is an important part of finding non-explicit links between entities (people, places, and things) as well as compiling information on those entities. The web has a lot of resources (URIs) that help describe the entities, but Machine Extraction along with other Machine Learning techniques may be what is necessary to help push forward with Tim Berners-Lee’s vision for the Semantic Web (a very powerful concept).

I would put this in the category of VERY advanced search with an HUGE amount of innovation potential!

Search Tech Opportunities- Improvement #7: Machine Learning as a Web Service

Posted in innovate this!, Innovation at 7:23 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the seventh opportunity that I see is with machine learning of various kinds. If you are not familiar with machine learning, take a look at Tom Mitchell’s book on the topic (funny, when I punched “machine learning” into Google, the first entry was an advertisement from Google asking “Want to work at Google?”)

This topic gets deep and broad very fast. I have put a lot of time into it over the years (starting with some credit card behavioral modeling in the early ’90s), but even with all the research I have done, I know only enough to be dangerous. Machine learning is relatively technical and relatively difficult to get exactly right (lots of math, CS, and art here).

I do, however, have a few non-technical thoughts on the topic:

What I would use it for…

Machine learning can be used for an amazing number of things (too many to describe here and many, many that I have not even considered). With respect to search (and assuming that all of my improvement ideas so far have had some level of development), innovators could create the following (and much more):

  • Propose tags for me on the social tagging (as I requested in an earlier post on tagging).
  • Given a set of resources (a.k.a., webpages, URIs), find resources that are similar (the find similar buttons on the search engines are really quite bad at this point. The approach that I would test would be asking the user what “dimensions” of similarity the user is looking for and then find everything similar. Note that the approach would use the feature vectors and models from the machine learning algorithms.
  • Automatically update my Ajax desktop pico-domain. There is refresh work that would need to be done in addition to the machine learning, but I should be able to develop algorithms that help me to quickly find and update resources in my domain-specific site.

These are just a few of the list of examples that solid machine learning can do. Clearly, it is not perfect, so I will still need to have some manual activity to sort through some bad results, particularly at the beginning. But, the machine learning will save me a lot of time.

An innovative service…

The problem is that building good machine learning models is a time intensive task that starts with creating a model building environment. While many of the large companies appear to be doing just this, most smaller companies are standing flat footed in this area, due to lack of understanding, resources, and skills.

So, how about an innovative On-demand (SAAS) service as an offering in this area from a company that has the skills (generally now operating as professional services groups)? Most internet services could use machine learning of one kind or another, but they do not have the resources/skills to set up the model development environment. The service could be helpful with code that helps create feature vectors (and other machine learning inputs), recommend modeling approaches for the particular class of problems, walk the user through the model building process, and back test the models. Finally, it could deliver the code for the models or, possibly, even implement the models on its own systems as an ongoing service.

Since the inputs are all available via the Internet and there is a lot of work in the set-up of the model building environment, this innovation lends itself pretty nicely to be set up as an internet based service.

Given that the process still has a fair amount of art in it, the service could also offer up expert model building advisors to its customers.

If some innovators do not move in this direction for the community at large to share, this will become a major area of strategic advantage for the larger companies over the next few years. Perhaps Alexa (or another innovator) will move in this direction for the benefit of many?
Huge amount of innovation potential here!

Search Tech Opportunities- Improvement #6: Feature Vectors

Posted in innovate this!, Innovation at 5:27 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the next few opportunities start getting slightly more technical. The sixth opportunity that I see is with more useful features in the search feature vectors and the mathematical combination of entries in those vectors.
Briefly, the current features that I can use to extract resources in the major search engines are word-based where each resource can be retrieved based on a series of words. (Note that this is not completely accurate, as there are a few other features that could be searched on such as language, file format, date of update, and domain suffix but the vast majority of the entries in the vector currently represent words).

Some Ideas (aimed at the search engines):

  • How about giving me a few more features to search on? For example, search engines seem to be storing away bolded and highlighted words to use in their prioritization schemes. How about exposing some of them so I can use them in a basic (or more advanced) search?
  • More advanced, give me the access to a large number of features that you are not already calculating, but should be (maybe you are already?). For example, I am always searching for interesting new technology product companies. Most of them have a tab-based link on their home page that says “product” (sometimes plural, but the stem is fine). How about a calculated feature that I can search on? This is one of a huge number of possible features.
  • Even better, let me make my own features calculations with some tools that you provide and you execute them and store them on your systems!
  • Just as important as the exposure to features, I would like to have the ability to make calculations off of the features and store them in your system. This will allow me to create some machine learning models (at a higher, concept level) and make the calculations in advance of my searches. (I will reduce the load on the systems by only uses specific features through this method, as I will use my composite variable for the resource extraction). This will also give me the ability to store some very advanced searches AND some of my schemes for prioritizing results. If you are really generous, you would allow me to make the calculations through the API as well.

I think Alexa already allows me to do this with its open platform, but I have not studied it enough at this point.

The net result is that I should be able to do some really interesting things with the information, especially if the other components of the open platform are in place (prior posts). The Amazon Camera Image search is one good example of what is possible (even if this does not interest you from a user standpoint, the search ability is amazingly specific).

Search Tech Opportunities- Improvement #5: Improved Tagging

Posted in innovate this!, Innovation at 3:29 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the fifth opportunity that I see is with improved tagging. (While tagging may not be thought of in a traditional search sense, the reason for tags is to find things, so I include it here.)

The basic issue is that, while I love the tagging sites, I suck at tagging. When I find a site that I like, I would like to remember it, so I tag it and put it on Delicious or Wink, right? Well, it doesn’t work very well for me for several reasons. First, I have a hard time thinking about the tags that I should have. Second, I have a hard time remembering my tags. Third, the thought pattern that I have at the time of tagging is usually different than the thought pattern that I have at the time of retrieval. Fourth, the semantic meaning of one person’s tags can be very different than another person’s tags. Finally, those tag clouds definitely were not build with me in mind (they are attractive in an artistic way, but hard to use).

The net net of it is that a given resource ends up being tagged more generally rather than specifically, gets tagged based on a thought at the time of tagging, and gets tagged in a subset of all possible tags. This causes all sorts of retrieval problems.

Some thoughts on improvements to tagging:

  • Bare minimum, when I find a resource that I want to tag, let me know what others have tagged it and let me tick off the tags that I want to use for it.
  • Allow users to put together tag trees (already starting to happen. Wordrpess, for example, allows me to nest categories to two levels) that allow the tagger and the reader to better understand how a given tag fits into the world (as a side note, everyone knows that single taxonomy trees suck, but facited tree taxonomies are in my view the ultimate approach which is effectively this point. In my view, there can be lots of different overlapping trees that change over time, which allows for the “messy” world to be described better.)
  • Allow users to create tag trees that can be used by other users.
  • Use machine learning to propose possible trees and tags at the time of tagging of a resource AND to propose trees and tags to the user at the time of search/retrieval.
  • I am not sure the answer to the tag clouds, especially if others like them. perhaps a more organized way of representing how tags or trees relate would be helpful?

Again, there is an enormous amount of innovation potential here…

Search Tech Opportunities- Improvement #4: Quickly Find What I am Looking for

Posted in innovate this!, Innovation, management at 2:06 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the fourth opportunity that I see is with getting back from a search exactly what I am looking for (a.k.a., user intent). There seem to be various issues and approaches to resolving this issue. I love Google (it looks like Fred Wilson likes Yahoo even more), but I think there are a lot of improvement opportunities available for getting me what I want a lot more quickly (of course, this cuts down on opportunities to show me advertising which could be an EXTREME disincentive for the large search engines to execute well here).

Some thoughts:

  • The current search approach is word-based. If I choose the right words, I get the right set of results. If I am clever (negative words, quotes, etc.), I will get even more accurate results. But what if I don’t know the right words (or, perhaps the sites don’t know the right words) and what if I am not clever? Quintura has a new solution to help me in certain ways (at least if I have a Windows machine at this point). Perhaps there are other, better ways as well, such as search engines offering up concept search in addition to word search, (and some other features that I will discuss in a later post). btw, I met with Quintura guys on my last trip to Moscow. Really smart team and making a lot of rapid progress with their product.
  • Even if the word-based search with the current word search, the SEO crowd has crowded out many of the sites that I am really looking for, so I still have a problem finding what I am looking for first. The Quintura-like solution will partially solve this problem, but one or more of the mashers (actually, most of the mashers) should allow me to take my starter set of URIs and allow me to reprioritize it in any way I like. How about by amount of traffic OR what my network thinks is good, OR what the bloggers (even better, technorati rated bloggers for this topic) talk about most OR anything else some clever person comes up with. I would also like the approach that allows me to combine different rating techniques in different ways to truly understand the “best sites” for me from various angles.
  • Of course, once there are enough pico-domains, the pico aggregator should allow me to find the pico-domain which should pretty quickly point me to the right resource (this is not a replacement, but rather another approach to the basic search approach).

Lots of room for innovation here (and I am sure I missed a lot)…

Search Tech Opportunities- Improvement #3: Mashups

Posted in innovate this!, Innovation at 2:00 pm by scottmaxwell

Following up my post on the opening of the search tech chain, the third opportunity that I see is with search-related mashups of various kinds (this is where the fun comes in!).

If the search tech system becomes more open, perhaps at least partially in the manner that I describe in my prior posts, it should give the foundation for mashups of various kinds (that I can not begin to imagine at this point). I am really impressed with the mashups that already exist and the amount of innovation that is going into them (see the Web 2.0 mashup matrix, which I mentioned last month, as a good source for the current innovation), but they all start with the same small set of useful APIs that currently exist. A host of new APIs will bring a host of new mash-ups (today there are 56 on Programmable Web. Adding one new API will bring a lot more than 56 new possibilities (as the two dimensional matrix implies) due to the possibility of using n of the APIs together (n is equal to or lower than the number of APIs).

One extreme version of this would be every Ajax desktop being able to be configured and released which covers a complete pico-domain, the pico-agregators (i.e., a tiny portion of the overall world that is homogenous in some way chosen by the aggregator) in a way that is not possible today. There are a lot of attempts to do this type of thing now, with domain specific directory sites,, and, more recently, Squidoo (and others), but all of them would have a great number of more complete and better approaches to presenting the best most complete and organized information with the foundation in place.

(Somewhat circular) Their should also be some great opportunities for pico-agregator search engines, which would allow a user to find the pico-aggregators of interest (this is done to some extent by Squidoo for its own lenses, for example, but needs to be extended to include all pico-aggregators).

Clearly, this is only one angle into mashups and many, many more exist. The bus is headed in this direction and I see nothing but a few speedbumps, detours, and stops at the gas station to stop it from reaching this destination. Lot’s of opportunities for innovators here!

Search Tech Opportunities- Improvement #2: Micropayment System

Posted in innovate this!, Innovation at 11:50 am by scottmaxwell

Following up my post on the opening of the search tech chain, this is a second improvement that I would like to see:

My last post was on opening up the APIs. While I would hope that we can start in beta or have some level of usage for free (ala Amazon’s API), I expect that at some point there will need to be a parallel effort to sort out the micropayment issues. Some thoughts:

  • The current RSS feed model of the user going to the content site works fine for the content site, but it is difficult for the search engines to create a revenue stream this way.
  • The Feed-plus-ad approach seems to be another approach, but the problem is that cascading value-add services will end up with a tremendous amount of ad space (unless there is some sort of coordination).
  • The Amazon model of a small payment per use seems like a fair one to me (and relatively easy to execute on)
  • Perhaps there is a more advanced one with respect to sharing advertising revenue or giving some real estate on the ultimate browser view for advertising to be delivered by the originating site.

Like the Blog and RSS feed approach, I would hope that some innovative companies could get this ecosystem going without the need for a payment system right away (free beta and ongoing small usage for free), but It seems to me that longer term there is a lot of innovation potential in this area!

Next page