Showing posts with label Summize. Show all posts
Showing posts with label Summize. Show all posts

Thursday, May 21, 2009

Twitter's Search Engine Is Very, Very, Broken

Given all the rumors about Google possibly talking to Twitter about search, or the Mountain View giant taking on the world of real-time, you would think that Twitter's dramatic growth and user adoption would see the microblogging company sitting on a gold mine of a database, as it amasses tweets from around the world and makes them searchable through the search.twitter.com product (formerly Summize). But it appears that the considerable expansion of the company's user base has led to strain on its index, rendering practically anything beyond realtime analysis completely useless, fraught with missing data and error pages.

The promise of Twitter's advanced search capability is tremendous - letting you dice your queries by the sender and recipient, and even limiting the date range for said tweets, the location, hashtags or even emoticons. And at one time, it was a valuable resource. Now, depending on which account you're viewing, the data set could be as small as a week, or oddly, in some cases, not available at all.

For example, if I search Twitter to find out how many times Erin Vest (@queenofspain) has mentioned the word "Obama", it would show me five total results spanning the last four days. Modifying the same search to start with May 1, 2009 or January 1 and continue to today completely fails, saying I probably "mistyped the address".


Searching Twitter for Erin's Mentions of Obama



Twitter Says Erin Has Said Obama Five Times



Modifying the Date to the Start of January



The Familiar Fail Page From Twitter Search


Out of curiosity, I performed the same search for "Obama" from Erin's Twitter account on FriendFeed, finding nearly 500 results, going back to March of 2008.


FriendFeed Shows Erin's Tweets Referencing Obama

Similarly, Twitter's advanced search says that I have never sent a tweet referencing Adam Ostrow (@adamostrow), yet FriendFeed confirms that I have.


Twitter Says I Have Never Sent a Note to Adam Ostrow



FriendFeed Shows My Tweets to Adam Ostrow

And lest you think Twitter had left behind us early adopters, archiving only tweets from the celebrities, I was surprised to find that you can't find Oprah's famous first tweet. I searched for the phrase "FEELING REALLY 21st CENTURY" from Oprah and found no results.


Where Is Oprah's First Tweet, Twitter?



I Know The Tweet Exists, Right?


In fact, searching for any tweets from Oprah at all showed no results. Oddly, in parallel, I could see 8 days worth of tweets from Ashton Kutcher and at least a few weeks' worth for my account.


Sorry, Oprah, Twitter Stopped Indexing Your Account

Back in February, I said that Twitter was best suited for following topics and listening to its search engine, and less for following people, and I do use Twitter search every day. But if they are to truly reach their potential, the company has got to find a way to find all the data that today, is missing and hard to find. If it's a scalability issue, Twitter has practically become a utility, like e-mail, and a solution is necessary, even if it means teaming up with a company that knows how to grow and scale. Be the suitor Microsoft, Google, Apple or anybody at that level, each offers a better alternative to the rapid dissolution of features and data integrity we are seeing today.

Of note, we did peruse the open API issues page in regards to search for Twitter, as well as reviewing the Get Satisfaction community for Twitter's Search product, but no comments have been made public about this data being unavailable that I can yet find.

We've seen Twitter go up, come down, remove features and add them back. Is this a temporary blip, or should we never again expect search to work the way it's advertised? I hope it comes back soon, and that Twitter becomes a reliable site to exchange messages, knowing they will be preserved, but their track record makes me very nervous that it may never happen.

Monday, April 13, 2009

Twazzup Takes On Twitter Search to Make Sense of Real-Time Web

Twitter's acquisition of Summize in 2008 gained the red-hot status update service arguably the most impactful new entrant into the Web 2.0 space last year, as the company looked to harness the millions of daily tweets flowing through its system and make sense of it all. Now rebranded as Twitter Search, the former Summize product is being relied upon for breaking news, trends, and acting as the pulse of the always-connected community, staying well ahead of Google and other traditional search leaders. Today, a new entrant, Twazzup, is looking to extend the Twitter Search platform, by not only providing real-time updates to the search results, but also highlighting popular users, links and tweets relevant to searched keywords.


The New Twazzup: for Searching Twitter

If you're familiar with the Twitter Search interface, it's well defined by its highlighting of hot topics that are rising on Twitter, being discussed by the masses, as well as its tendency to pile up queued tweets that have not been displayed. To get the new tweets, you need to refresh. But not with Twazzup, who rolls in the new results in real time, much like FriendFeed's new beta interface. Also similar to that interface, Twazzup features a user-friendly pause button in the top right to slow things down a bit.


Twazzup Results for Obama


Twazzup Results for Baseball

Today, Twitter Search is all about getting you the results, period. Its options are very spartan. For example, if you search for Facebook, you see the results and can either reply to the author, or view the specific tweet. But there's no data about the authors or the topics.

On Twazzup, the same query for Facebook shows search results, and a helpful kind of subset of results that displays related topics. For Facebook, I could also click the word social, and see when both Facebook and Social are in the same tweet. (that result is here) Other topics, like networks, linkedin and strategy also pop up when both Facebook and social are combined.

But beyond combining search terms, Twazzup's right side column does more than just show hot topics, like Twitter Search does. It also shows a popular tweet that contained the search terms, top "trendmakers", who talk about those terms and drive retweets or click-throughs, and popular links that are spawned from those keywords on Twitter.


Twazzup Trendmakers and Popular Tweets for Obama

For me, searching Twitter is practically as useful as messaging via Twitter, as it offers a lens into not just what people "are doing", but what they are thinking, observing or talking about. Given Twitter's driving an ever-closer integration with its acquired Summize product, I expect more users to flock toward the standard Twitter Search than to new products that arrive, like Twazzup, but as Twitter thus far has done very little to expand the Summize product beyond its initial feature set, there is significant room for third party services to improve the status quo.

Twazzup can be found at http://www.twazzup.com, and on Twitter, of course, at http://twitter.com/twazzup. The company's CEO and Co-Founder is Cyril Moutran, who launched Yokway last year. (See our initial coverage)

Tuesday, December 9, 2008

10 Top New Web Services of 2008 and Their 2009 Forecast

2008 has been both an exciting year and a very trying year for the world of Web innovation.

When the year kicked off, we were still in the middle of Web 2.0 fever. We were just two months removed from Microsoft having invested $240 million in Facebook at a stratospheric $15 billion. In the first week of January, Yahoo! CEO Jerry Yang made his first appearance at CES and promised the company was "ready and excited". By mid-month, Pownce launched to the public to offer an alternative to Twitter. And by the end of January, Twitter crashed hard - for the first time.

It turns out that Twitter's crash might have been the canary in the coal mine. Even looking at January 2008, and considering what has happened to Facebook's valuation, Jerry Yang's reign as CEO of Yahoo!, and the eventual extinguishing of Pownce in the ensuing months and it almost seems unbelievable. Of course, as you know, Twitter crashed again and again throughout the year, and in parallel, so did the fortunes of many Web companies, from the smallest startup looking to raise funds, to the monoliths, including Google and Yahoo!, who have had to rapidly make changes as the economy changes under their feet. Meanwhile, as business conditions deteriorated, the public markets were closed and valuations were decimated.

But before the doom and gloom hit, a good number of Web services pushed and shoved their way out the door in the first half of the year, and look to be here for at least the near term. Even as the second half of the year saw a drying up in new services and very little innovation, as we start to look toward 2009, there are new brands that many of us know were but a glimpse in an engineer's eye when 2007 finished and 2008 took over. And while no list is complete, here are some of the best that can claim 2008 as their birth date. I expect this will miss quite a few, so please make sure to nominate your favorites and tell me why I'm wrong!

1) Summize (Twitter Search)

Search is still king, and real-time search is having a huge impact on the way people find news, share ideas, and see trends. Summize built its business around being a search engine for Twitter, and soon became more stable, and theoretically, more useful, than Twitter itself. The Twitter team, in desperate need for more engineering help, acquired the company and absorbed into the microblogging service.

Expected Exit: Acquired - Already Complete

Twitter's acquisition of Summize was a smart move, considering how real-time search is becoming critical in times of breaking news. Many, including myself, are turning to Twitter search instead of Google, Yahoo! and the traditional news wires to hear reports from people on the ground, unfiltered.

2) Socialmedian

While many different sites have conquered the online activities aggregation space, Socialmedian went about the process in a different way than all the others, letting people not only follow friends and pipe in their shared content from a wide variety of 3rd party sites, but organized it in terms of categories. The category feature was so successful, CEO Jason Goldberg has been able to showcase specific events, including the 2008 election, and the financial crisis, and make Socialmedian a go to site to interact with "newsmakers". The site, starting from scratch in the Spring, has risen up to challenge FriendFeed, Digg and other sites for social news - and continues to grow at a rapid clip.

Expected Exit: Acquisition by First Quarter of 2009

With Goldberg and team having raised so little capital to get the product off the ground, and having kept costs very low, with the development team in India, the bootstrapped Socialmedian looks to be a ripe target for an acquisition, in my opinion. Without strong revenues and the public markets the way they are, Socialmedian would be smart to find a strong content or media partner, to join forces and enable the service to continue its growth.

3) BackType

Technorati and Google Blog Search, as well as many other directories and search engines have typically focused on the blog as the central nervous system for their offering. But as many would agree, it is the comments and conversation, no matter where they are, that have real meaning to blog authors and participants. While everyone was busy trying to see who could land on the Techmeme leaderboard or break new ceilings in Technorati Authority, BackType debuted a site that tracks comments by individual, lets you follow individual commenters across a wide variety of sites, be alerted when comments with keywords take place, and see charts that display keywords' momentum.

Expected Exit: Acquisition in Second Half of 2009

The BackType founders are working together on their second startup, having abandoned the first when it didn't gain traction. While BackType doesn't yet have an amazing market presence, they have forged a unique foothold that so far looks unchallenged. With any luck, I would expect the BackType team to deliver more enterprise-capable brand and identity management tools that would enable the service to gain revenue and exposure, letting the service to remain independent through the majority of 2009 before finding a place within WordPress, Six Apart, Google or Twitter.

4) TweetDeck

TweetDeck isn't a Web service, but this Adobe AIR application introduced new functions to Twitter usage that changed the game in terms of how people use the service. By introducing a multi-columned app that features groups, integrated search, direct messaging, and replies functionality, many are swearing by TweetDeck, and it looks like it may soon overtake Twhirl as the most popular Twitter application. Busy Twitter addicts including Guy Kawasaki swear by it.

Expected Exit: Remaining Independent through end of 2009

Iain Dodsworth is continuing to upgrade the product, and it's widely rumored he may soon integrate multi-account support, as well as integration with additional services, outside of Twitter. If he can get enough people to donate or pay for the application, there's no question he could make a full-time living from the resulting revenue. The question is, will people who expect a free service to have 100% uptime spring for the app that gets them there?

5) Strands

While FriendFeed, Profilactic and others were first out the gate in 2007 with their lifestreaming and social activity aggregation tools, Strands has worked on their own social news and lifestreaming site, in beta, since mid year. Focusing on delivering a clean interface for their Web, mobile and iPhone application versions, and keeping a strong emphasis on tracking musical preferences, Strands has developed a loyal following who find the site less noisy than some services and cleaner than others. Strands, instead of marketing to early adopters, like me, has given a great deal of focus to converting the more mainstream user, and acting as an evangelist for other third party applications, ranging from Pandora to Twitter.

Expected Exit: Remaining Independent through end of 2009.

Strands' history both bodes well and plays against them. Their VC funds offer them a strong balance sheet, but may also force the company's investors to seek a return that would be unavailable, given current market conditions. The company will need to find a better way to differentiate against FriendFeed and others, and hope that appealing to mainstream America works.

6) ReadBurner

A service that would tabulate the most frequently shared items from Google Reader was high on my list of sought-after sites in 2007. The catch is that I always thought Google would do it themselves. When ReadBurner debuted in January, it was a delight, and the simplicity of the service bred many clones, including RSSmeme. Later in 2008, its older cousin, Feedheads, broke out of the Facebook garden and entered the general Web. ReadBurner, and others like it, serve as having the potential to unseat less-democratic popular news hierarchies, such as Digg, assuming they execute well. As an advisor to the service, I'd like to say they are on the right track, or rate the service higher on this list, but development has been slow of late, and needs to get going again.

* Not Listing an Expected Exit Due to Assumed Bias *

7) Feedly

Like many other smaller services this year, especially those around the Google Reader and Twitter ecosystems, Feedly takes an existing popular product and makes it better - giving a news magazine feel to what previously had been a standard RSS reader. Feedly launched as a Firefox plugin in the middle of the year, highlighting recommended articles from friends, popular feeds, and integrating with Google Reader, so when you made changes to your Feedly, those changes tracked back to Reader.

Expected Exit: None

Feedly's founder recently noted his excitement over earning the service's first dollar, after a user Tweeted that she'd gotten distracted by an ad within Feedly and clicked through. Given most other RSS based apps haven't found any revenue yet, a single dollar is a lot more than zero, but Feedly doesn't look like it has any kind of mass that would push it to the mainstream, let alone turning into a viable business. For now, it's just an interesting twist on data consumption. The site will only go away if its developers get bored of it.

8) Gnip

With sites like Twitter, Facebook, Flickr, Delicious and others getting pounded all day by third party services tapping into their API and sucking down their users' updates, Gnip recognized these external sites might soon see backlash from the data sources, as too much of their own infrastructure was being used to power other programs. In light of Twitter's up and down summer, Gnip debuted to act as the middleman, essentially making data portability easier, reducing one-offs between services.

Expected Exit: Acquisiton by end of 2009

It's hard in life to be the middleman, trying to play equal with every service. Should Gnip really start to become the Akamai of data portability, it's likely that one of the biggest data producers would want to snap up the service for themselves, and either limit competitors' access to it, or start charging fees. In a world when VC money is hard to come by, Gnip would be smart to take the offer.

9) Toluu

You'll note two major themes regarding hot services in 2008: RSS and friends. Finding out what your friends were reading and sharing were key facets of most of the new products that gained my attention this year. Toluu, developed by Caleb Elston, offers a site where you can upload the OPML file of feeds you read, mark your favorites, and see how compatible you are with other users of the site, helping find new feeds, and new people. Over time, the service enabled me to see new blogs my friends were subscribing to, and you could even notify Twitter if you had added a new blog to your reading list.

Expected Exit: None

Toluu is a geeky hobby for Caleb. He's recently also gotten behind Kallow.com, a gift recommendation service. Toluu hasn't been monetized in any way, and is unlikely to develop into an acquisition target, unless another service wants to use his recommendation engine.

10) SocialToo

Twitter and Facebook have become such a part of the blogging ecosystem, that new services have sprung up to make it more useful and intuitive. Among them is fellow louisgray.com author Jesse Stay's SocialToo. The service looks to act as a bridge between multiple social networks, including Twitter, Identica and Facebook, letting you automatically follow those users who follow you, offering a black list of people you never want to follow you, setting up an automatic message to those who choose to follow your account, and recently, the addition of surveys that can be distributed by Twitter and tabulated on the site, much like SurveyMonkey and PollDaddy.

Expected Exit: Remaining Independent through end of 2009.

SocialToo contains some advertising, and if I were to guess, it may offer premium features, as the survey functionality could be improved a great deal, possibly even going head to head with sites like SurveyMonkey. While Jesse is unlikely to get rich off SocialToo, it's smart in that it's not tied just to one service (Twitter), but has the flexibility to add on new networks as they rise in prominence.

Also on the list but outside of the Top 10:
12seconds.tv, BlogRize, Identica, LinkRiver, OneSpot, PeopleBrowsr, Plurk, Rejaw, RSSmeme, Shyftr, Yokway

Monday, July 14, 2008

TweetDeck Twitter Client Gains High Profile Amid High Expectations

On July 4th, I had the opportunity to help introduce TweetDeck to the blogosphere as a fully-featured Twitter client, based on the Adobe AIR platform, with Summize integration, and the option to show Tweets in multiple columns, including dedicated screen space for replies, and customizable grouping. While the Twitter client space has already seen good penetration by Twhirl, Feedalizer and others, TweetDeck has gained a strong following over the last ten days, with many testing, and a good number, including me, using it as our default interface to Twitter's microblogging platform.


Tweetip Shows the Boom in TweetDeck Use and Discussion

In fact, the blog Tweetip, which watches Twitter closely to capture inflection points of when one term or another rapidly changes on the service, captured the boom in TweetDeck commentary last week, showing how much more mindshare the application got following our first post. But just because a lot more people know about the service doesn't mean it has a free ticket to application stardom. I asked people on Twitter and FriendFeed yesterday if they had made the switch. (See the FriendFeed discussion)

For every "Yes, been using it since launch+1, and still using and loving it!" and "Yes... And yes. Like it a lot" I received, I also got a few responses like "No. uses too much real estate" or "Use tweetdeck but prefer twhirl because it gives me Friendfeed and multiple twitter user accounts at the same time."

While I like TweetDeck's ability to display in multiple columns as a full-screen application in the background, others prefer the single-column look of alternative applications. Also, over the last week-plus, I heard calls to separate Twitter replies from Twitter direct messages. And in both cases, developer Iain Dodsworth delivered. Both the single-window feature, as well as a single column for DMs are available in the latest beta.


TweetDeck Added Support for Direct Messages


TweetDeck Added Support for a Single Column View

With such a healthy debut, users are expecting TweetDeck to grow up and do even more, including incorporating FriendFeed streams, as Twhirl and other newcomers do. I don't know that Iain has these plans, but if he did, the crowd which uses both might find the service even more intriguing. I'm also curious to see if TweetDeck would make any sense in an interface like the iPhone. With Twitterific debuting on the iPhone and iPod Touch on day one, it will be hard for competitors to make headway, especially those that use the AIR platform.

TweetDeck is in public beta, and can be found here: http://tweetdeck.com/beta/. Other reviews so far of TweetDeck include those from ReadWriteWeb, /Message and The Download Squad.

Writing Once, Publishing Many Times, Makes Context Critical

Whether Web services leverage RSS, send e-mail confirmations or are indexed by keywords in specialized search engines, it's not too uncommon for any activity you make online to set off a series of actions. When taken out of context, something you said in one place won't make as much sense somewhere else. A sentence fragment or a response might be completely confusing to one audience or at a certain time. With this in mind, best practices would suggest writing in full sentences where possible, and offering context.

Two Examples:

Sending replies in Twitter

Often, I will be following "Person A" and they will be following "Person B", but I won't be. If Person A sends a note to Person B, Twitter may often catch that as a reply, and clicking through the "in reply to" link will give you Twitter's best guess as to what Person A was responding to. But this doesn't always work.

Here's how it often happens:
Tweet 1: Person B: "@persona, are you up for seeing Wall-E at the Metreon?"
Tweet 2: Person B: "AFK for 15 minutes, got to get dog food."
Tweet 3: Person A: "@personb, I'd love to go. See you at six."
To the Twitter user following Person A, clicking the "in reply to" would make it sound like the pair were off to consume some Kibbles 'N' Bits, as Twitter usually grabs the latest tweet from the person to whom the tweet was sent as the message.

What would have been better is if that 3rd Tweet had read:
Person A: "@personb, I'd love to go see Wall-E. The movie sounds great. I'll see you at six."
Now, if I'm following only half the conversation, I get the idea, even without having to click through, and I won't think you are a huge Alpo fan.

Also, Tweets are read in more places than just Twitter these days. If I had set up a Summize search for "Wall-E", I would have seen Person B's initial tweet, but not the second one, from Person A, unless they put Wall-E in the response. And if I were following Person A on FriendFeed, the tweet with details would make a lot more sense, when jumbled in the rest of their activity.

The idea of writing in full sentences or giving context is to understand the audience for your messages is larger than you realize, and you should write for the followers on the periphery.

Making comments using Disqus

When I make a comment in Disqus, at least five things can happen:
  • A comment is added to the originating blog.
  • An e-mail can be sent to the blog owner saying a new comment has published.
  • An e-mail can be sent to the person I am replying to if I am in a thread.
  • A copy of that Disqus comment is added to my personal Disqus page.
  • The full copy of that comment goes to aggregators like FriendFeed, Profilactic and SocialThing.
Because the Disqus comments can go in so many places, it is especially important to try and highlight the name of the person I am responding to, give context to the reply and to write in full sentences. This way, the comment, wherever it may be seen, can make sense. When I make a comment in Disqus, I am thinking about the fact it's not just publishing to the blog author and commenter, but to those people who have not yet been part of the conversation. This you can see from my Disqus stream on FriendFeed or my profile on Disqus.

For a good idea of how the world uses Disqus, check FriendFeed's public stream of Disqus comments:

Here's one that has no context:
Svartling:"No sorry. But you can look here: Link"
Here's one that works well:
Svetlana Gladkova: "Very true Shey, I have seen it pretty often that a post from Profy receives, say, 30 likes on FriendFeed and a dozen of comments, and our server stats only shows a dozen of people actually visiting the post to read it and leave a comment on FF (if that is the place they prefer to leave comments). It is annoying when I realize that people only use FF to create some presence for themselves by liking and commenting titles instead of actually consuming the content they pretend to like - I think it is even worse than fragmentation of comments that FF initiates."
As aggregators play an increasing role in how we gather information on the Web, it's now possible for our comments on Digg, StumbleUpon and Google Reader shared items, as well as those from other services, to become part of our lifestream. In addition to Twitter and Disqus, two of the major examples, we should know that every time we say "LOL! I totally agree!" when we could have said, "Wow, thanks for sending me to this YouTube video of Conan O'Brien's Friday monologue. You're right, John McCain is old!", you're losing the opportunity for readers who find you in a different place to be part of the conversation.

Much of the time, one-sided conversations without context are called noise. You can actually reduce noise through carefully crafting the signal around the noise. It takes a little bit extra work, but it's well worth it.