Readings

April 4, 2009

1. MetaCarta GeoParsing API

2. Open Calais :Calais is a rapidly growing toolkit of capabilities that allow you to readily incorporate state-of-the-art semantic functionality within your blog, content management system, website or application.

3. Tweetburner

4. fuseURL

5. http://dittes.info/blog/2008/06/04/presseclipping-20-twitter-monitor/

6. http://www.wefeelfine.org/   :  An exploration of human emotion

7. http://www.monitter.com/   Monitoring Twitter [could insert a definition/word in order to get the exact phrase ]

8. http://www.tweetdeck.com/beta/  : aims to make all your Twitter experience as accessible as possible.

You can put your followers into groups, and save keyword searches. The drawback to Tweetdeck is that the timeframe is only 48 hrs, so aything after that can not be accessed. I still do think that TweetDeck is a break through act and is still in Beta so expect more to come.

9. http://hounder.org/index.html : Hounder is a simple and complete search system. Out of the box, Hounder crawls the web targeting only those documents of interest, and presents them through a simple search web page. Hounder is:

  • configurable: Hounder can be customized for your particular needs. Use it as a standalone solution or as a building block for your existing application.
  • scalable: Hounder grows with your needs. Start with a single machine, add more as needed.
  • robust: The big bad web is no place for puppies. Hounder’s searcher has been designed from the beginning to survive traffic surges.
  • easy to integrate: Hounder can be used from various languages, such as Java, PHP, Python, etc.
  • trainable: point Hounder’s attention to the information you want by feeding it with training sets, then sit back and watch it fetch the right documents for you.

10. http://code.google.com/p/wiz4j/   :  Wiz4j offers a simple and rapid method to create wizards in java.

Its quick and easy, no need to create xml files: just use java code to define the wizard structure.

With wiz4j, your wizard will run both in GUI and command line mode.

11. http://tweetstats.com/trends

12. http://www.trackur.com/ : Trackur is an online reputation monitoring tool designed to assist you in tracking what is said about you on the internet. Trackur scans hundreds of millions of web pages–including news, blogs, video, images, and forums–and lets you know if it discovers anything that matches the keywords that interest you.

13. http://www.twitscoop.com/about : Through an automated algorithm, twitscoop crawls hundreds of tweets every minute and extracts the words which are mentionned more often than usual. The result is displayed in a Tag Cloud, using the following rule: the hotter, the bigger

14 .

Articles

December 31, 2008
 
 

Grid Explained – The basics of Grid

 
 
 
To drive sustainable business growth, organizations are constantly driving their information technology systems to produce business results sooner and make them available to a wider audience, with improved accuracy and usefulness at the point of need. At the same time, organizations are looking to embrace new computing technologies such as provisioning, orchestration and virtualization and the emerging new standards for interoperability to improve their systems’ resilience and make more efficient use of human, technology, and capital resources.
 
 

CIO Magazine about Grid Computing

 
 
 
Special Report
Grid computing has been on the horizon for a long time. Some prognosticators say it’s the next big thing. But it’s SO big, it’s daunting for many. This collection looks at the basics of grid as it moves ever (so slowly) closer.
 
 

Getting Started With Grid

 
 
 
An increasing number of organizations recognize the potential benefits of grid and related virtualization technologies, and they are rapidly beginning to exploit those benefits.
 
 

The Banker: When the whole is greater than the sum of the parts

 
 
 
When the whole is greater than the sum of the parts
When the whole is greater than the sum of the parts
Published: 04 November, 2004
Grid technology underlies many of the utility models of computing mooted to revolutionise industry. It is being put to use in financial services organisations and in some cases already providing compute power as a utility. Dan Barnes reports.

In the race to come up with the latest collateralised debt obligation (CDO) structure or another kind of derivative, the secret weapon of advantage could be grid computing. Million dollar profits can be earned by banks that reap first mover advantage in derivatives but often they are held back by a lack of raw computing power. Grid computing harnesses unused capacity in a bank’s PCs and servers to get the calculations done rather than relying on existing mainframes or supercomputers. It consolidates and allows a measured co-ordination of computing resource.

 
 

McKinsey: Managing next-generation IT infrastructure

 
 
 
In recent years, companies have worked hard to reduce the cost of the IT infrastructure—the data centers, networks, databases, and software tools that support businesses. These efforts to consolidate, standardize, and streamline assets, technologies, and processes have delivered major savings. Yet even the most effective cost-cutting program eventually hits a wall: the complexity of the infrastructure itself.
 
 

Grid Computing in the Enterprise

 
 
 
February 9, 2004
Grid computing is an overnight success that has been almost four decades in the making.
Last month’s announcement of the WS-Resource framework, enabling grid resource management with standard Web services protocols, completes a convergence that began with the 1965 introduction of the first multiprocessor computer. Libraries full of bleeding-edge research have since paved grids’ way, developing parallel processing schemes to solve exotic and high-value problems.
 
 

Automation know-how

 
 
 
Automation know-how
06 January 2005
Emerging automation tools are making the new data centre more self-reliant than ever.
By Denise Dubie, Network World

The new data centre, with its rapid rate of change and growing complexity, demands software that integrates seamlessly to intelligently automate a range of IT management tasks.

True end-to-end automation in the new data centre would also eliminate the chance that human errors could cause outages or performance problems. Without such over-arching automation, collecting data from multiple sources, making sense of it, putting it into a common format and then knowing what action to take based on business policies will challenge many IT shops in the coming years.

“It will take time, money and know-how about the capabilities available from vendors and those that can be used in-house, but the technology will eventually be available and a culture shift will happen. Automation will mean we can make more services available, at a lower cost, with more accuracy – and that really matters,” says Janice Newell, CIO of Group Health Cooperative in Seattle, USA.

Understanding automation resource by resource is the first step in that process.

 
 

Autonomic attack plans

 
 
 
Autonomic attack plans
08 January 2005
Three vendors are battling head-to-head for mindshare of self-managed systems.

Whenever a new technology or methodology seems poised to shake up enterprise IT, vendors hustle to spin the phenomenon in their direction.

One such concept has been the self-managing data centre, often referred to as “autonomic computing,” the term IBM favours. Here, the goal is to design and implement systems that monitor themselves, repair themselves as necessary, protect themselves from external threats and even re-route their own resources to best meet business needs. (That last factor echoes the promise of another red-hot phenomenon, on-demand – or utility – computing.)

 
 

The new data centre: where are we now?

 
 
 
where are we now?
What is the new data centre?
The new data centre has moved from the conceptual idea it was a year ago to a production infrastructure that today’s early adopters are testing and deploying. As the new data centre evolves, all agree that a long-range plan will be based on two ideas. First, the new data centre relies on a new business model, the extended enterprise, which is in itself the basic building block for yet another emerging business model – the global ecosystem. Second, the basis for the extended enterprise’s (and, eventually, the global ecosystem’s) IT infrastructure will be change management.
 
 

The future of the data centre

 
 
 
The future of the data centre
A revolution is underway in data centre technology. And it is being driven by customers desperate to cut costs and improve responsiveness.

Standards

December 31, 2008

Extensible Messaging and Presence Protocol (XMPP)

 
 
     
 

The Reservoir project – Clouds Interoperability

 
 
 
Resources and Services Virtualization without Barriers is an European Union FP7 funded project that will enable massive scale deployment and management of complex IT services across different administrative domains, IT platforms and geographies. The project will provide a foundation for a service-based online economy, where – using virtualization technologies – resources and services are transparently provisioned and managed on an on-demand basis at competitive costs with high quality of service.
 
 

3Tera “Open Cloud”

 
 
     
 

Open Virtualization Format (OVF)

 
 
     
 

BitTorrent (protocol)

 
 
     
 

SOAP

 
 
     
 

Representational state transfer (REST)

 
 
     
 

Cloud Nine: Specification for a Cloud Computer. A Call to Action.

Open Source

December 31, 2008

Puppet

 
 
 
Put simply, Puppet is a system for automating system administration tasks. To learn more, read our big picture overview of Puppet, or take a deeper look at what Puppet can do with the Puppet Introduction. There’s also an about Puppet page which gives the highlights of Puppet’s functionality.
 
 

Pig

 
 
 
We are creating infrastructure to support ad-hoc analysis of very large data sets. Parallel processing is the name of the game. Our system runs on a cluster computing architecture, on top of which sit several layers of abstraction that ultimately bring the power of parallel computing into the hands of ordinary users. The layers in between automatically translate user queries into efficient parallel evaluation plans, and orchestrate their execution on the raw cluster hardware.
 
 

Nimbus

 
 
 
The University of Chicago Science Cloud, codenamed “Nimbus”, provides compute capability in the form of Xen virtual machines (VMs) that are deployed on physical nodes of the University of Chicago TeraPort cluster (currently 16 nodes) using the workspace service.

Nimbus is available to all members of scientific community wanting to run in the cloud. To obtain access you will need to provide a justification (a few sentences explaining your science project) and a valid grid credential (If you don’t have a credential, email us. We can help). Based on the project, you will be given an allocation on the cloud.

 
 

Hadoop

 
 
     
 

Eucalyptus

 
 
 
EUCALYPTUS – Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems – is an open-source software infrastructure for implementing “cloud computing” on clusters. The current interface to EUCALYPTUS is compatible with Amazon’s EC2 interface, but the infrastructure is designed to support multiple client-side interfaces. EUCALYPTUS is implemented using commonly-available Linux tools and basic Web-service technologies making it easy to install and maintain.
 
 

OpenNebula

 
 
     
 

Enomalism

 
 
 
Enomalism is an open source web-based virtual infrastructure platform. Designed to answer the complexity of managing globally disperse virtual server environments. Enomalism helps to automate the transition to a cloud computing environment by reducing an IT organizations overall workload. The easy to use dashboard can help with issues including deployment planning, load balancing, automatic VM migration, configuration management, capacity diagnosis and resource monitoring/metering.

Gridgain

 
 
 
GridGain is focused on doing one thing – providing the computational grid platform for Java.
 
 

Globus Toolkit

 
 
 
The open source Globus Toolkit is a fundamental enabling technology for the “Grid,” letting people share computing power, databases, and other tools securely online across corporate, institutional, and geographic boundaries without sacrificing local autonomy. The toolkit includes software services and libraries for resource monitoring, discovery, and management, plus security and file management.
 
 

Mosix

 
 
 
MOSIX is a management system that allows a Linux cluster or a Grid of clusters to perform like a single computer with multiple processors. It is particularly suitable to run intensive computing and applications with moderate amounts of I/O.
 
 

Jini

 
 
 
Jini.org is a central place and resource for the Jini CommunitySM. It is a site to discover new information, discuss, collaborate, exchange source code and ideas, and advance Jini™ network technology.
Jini network technology is an open software architecture that enables the creation of network-centric solutions which are highly adaptive to change.
 
 

SUN Grid Engine

 
 
 
The Grid Engine project is an open source community effort to facilitate the adoption of distributed computing solutions. Sponsored by Sun Microsystems and hosted by CollabNet, the Grid Engine project provides enabling distributed resource management software for wide ranging requirements from compute farms to grid computing.
 
 

Unicore

 
 
 
UNICORE (Uniform Interface to Computing Resources) offers a ready-to-run Grid system including client and server software. UNICORE makes distributed computing and data resources available in a seamless and secure way in intranets and the internet.
 
 

Open MPI

 
 
 
A High Performance Message Passing Library
Open MPI is a project combining technologies and resources from several other projects (FT-MPI, LA-MPI, LAM/MPI, and PACX-MPI) in order to build the best MPI library available. A completely new MPI-2 compliant implementation, Open MPI offers advantages for system and software vendors, application developers and computer science researchers.
 
 

OSCAR

 
 
 
OSCAR (Open Source Cluster Application Resources) is a snapshot of the best known methods for building, programming, and using HPC clusters. It consists of a fully integrated and easy to install software bundle designed for high performance cluster computing. Everything needed to install, build, maintain, and use a Linux cluster is included in the suite, making it unnecessary to download or even install any individual software packages on your cluster.
 
 

Xen

 
 
 
Modern computers are sufficiently powerful to use virtualization to present the illusion of many smaller virtual machines (VMs), each running a separate operating system instance. Successful partitioning of a machine to support the concurrent execution of multiple operating systems poses several challenges. Firstly, virtual machines must be isolated from one another: it is not acceptable for the execution of one to adversely affect the performance of another. This is particularly true when virtual machines are owned by mutually untrusting users. Secondly, it is necessary to support a variety of different operating systems to accommodate the heterogeneity of popular applications. Thirdly, the performance overhead introduced by virtualization should be small.
 
 

OGSA-DAI

 
 
 
The aim of the OGSA-DAI project is to develop middleware to assist with access and integration of data from separate sources via the grid. The project was conceived by the UK Database Task Force and is working closely with the Global Grid Forum DAIS-WG, the OMII and the Globus team.
 
 

OpenVZ

 
 
 
OpenVZ is an Operating System-level server virtualization solution, built on Linux. OpenVZ creates isolated, secure virtual private servers (VPSs) or virtual environments on a single physical server enabling better server utilization and ensuring that applications do not conflict. Each VPS performs and executes exactly like a stand-alone server; VPSs can be rebooted independently and have root access, users, IP addresses, memory, processes, files, applications, system libraries and configuration files.
 
 

openQRM

 
 
 
openQRM is designed to deal with all sorts of failures automatically, thus preventing interrupts because of unexpected events.
Implementing openQRM greatly improves the reliability of the x86 data-center.
openQRM is an open source systems management platform which integrates with existing components in enterprise data centers to create scalable, highly available and customizable infrastructures.
 
 

Gridsphere

 
 
 
The GridSphere portal framework provides an open-source portlet based Web portal. GridSphere enables developers to quickly develop and package third-party portlet web applications that can be run and administered within the GridSphere portlet container. Here you will find the GridSphere portal framework available for download and documentation related to the installation and development of portlets using GridSphere.
 
 

GAT – Grid Application Toolkit

 
 
 
The objective of this workpackage is to design and build a Grid Application Toolkit (GAT) and to plug-in to this GAT the services developed in other GridLab workpackages.
GAT is a set of coordinated, generic and flexible APIs for accessing Grid services from e.g. generic application codes, portals, data managements systems, together with working implementations provided by the tools developed in the Grid Lab project (See the figure below). GAT is designed in a modular plug-and-play manner, such that tools developed anywhere can be plugged into GAT.
 
 

Mandriva

 
 
 
Mandriva is a worldwide Linux and Open Source leader providing easy-to-use solutions to individuals and organizations.
 
 

Alchemi

 
 
 
Alchemi is an open source software framework that allows you to painlessly aggregate the computing power of networked machines into a virtual supercomputer (desktop grid) and to develop applications to run on the grid.

It has been designed with the primary goal of being easy to use without sacrificing power and flexibility.

Alchemi includes:
The runtime machinery (Windows executables) to construct computational grids.
A .NET API and tools to develop .NET grid applications and grid-enable legacy applications.

 
 

NGRID

 
 
 
NGrid is an open source (LGPL) grid computing framework written in C#. NGrid aims to be platform independent via the Mono project. NGrid aims to provide

a transparent multithread programming model for grid programming.
a physical grid framework & some grid implementations.
common utilities both for grid programming or grid implementations.

 
 

Crossbow – Network Virtualization and Resource Control

 
 
 
Crossbow provides the building blocks for network virtualization and resource control by virtualizing the stack and NIC around any service (HTTP, HTTPS, FTP, NFS, etc.), protocol or Virtual machine.

Each virtual stack can be assigned its own priority and bandwidth on a shared NIC without causing any performance degradation. The architecture dynamically manages priority and bandwidth resources, and can provide better defense against denial-of-service attacks directed at a particular service or virtual machine by isolating the impact just to that entity. The virtual stacks are separated by means of H/W classification engine such that traffic for one stack does not impact other virtual stacks.

Project Crossbow is next step in the evolution of Solaris networking stack and brings bandwidth resource control and virtualization as part of the architecture itself instead of the usual add-on layers which have heavy overheads and complexity.

 
 

ProActive

 
 
 
ProActive is a GRID middleware (a Java library with Open Source code under LGPL license) for parallel, distributed, and concurrent computing, also featuring mobility and security in a uniform framework. With a reduced set of simple primitives, ProActive provides a comprehensive API to simplify the programming of Grid Computing applications: distributed on Local Area Network (LAN), on clusters of workstations, or on Internet Grids. Portability, Openness, Agility: Write Once, Deploy Everywhere !
 
 

Solr

 
 
 
Solr is an open source enterprise search server based on the Lucene Java search library, with XML/HTTP and JSON APIs, hit highlighting, faceted search, caching, replication, and a web administration interface. It runs in a Java servlet container such as Tomcat.
 
 

Distributed Search for Solr

 
 
     
 

Hadoop

 
 
 
Hadoop is a software platform that lets one easily write and run applications that process vast amounts of data.
 
 

dCache

 
 
     
 

Linux Virtual Server

 
 
     
 

VirtualBox

 
 
 
innotek VirtualBox is a family of powerful x86 virtualization products for enterprise as well as home use. Not only is VirtualBox an extremely feature rich, high performance product for enterprise customers, it is also the only professional solution that is freely available as Open Source Software under the terms of the GNU General Public License (GPL). See “About VirtualBox” for an introduction; see “innotek” for more about our company.
 
 

Talend Open Studio – open source data integration solution

 
 
 
Talend Open Studio, the industry’s first pure open source data integration solution, combines metadata-driven design and execution, with an easy-to-use graphical development environment, to deliver better scalability at a lower total cost of ownership than traditional data integration or Extract, Transform and Load (ETL) solutions. Talend’s technology and business vision shatters the traditional proprietary model and provides the flexibility required to meet the needs of all organizations – regardless of their size, level of expertise or budgetary constraints. To download, please visit

Desktop Virtualization

December 31, 2008

g.ho.st

 
 
     
 

Nomachine

Cloud Services Providers

December 31, 2008
  

Amazon Web Services

 Apple MobileMe Cloud Services
  

Appnexus

  

AT&T

Datapipe

  

Digitalribbon

  

Distributed Potential

emailcloud

  

Engineyard

 

Flexiscale

 

HP

 

icloud

  

ItricityHosting

  

Layered Technologies

  

Layeredtech

Media Temple

  

mediatemple

  

Mosso

Netsuite

  

Nirvanix

Parascale  

Q-layer

Rackspace

Savvis

  

Servepath

  

SIMtone

  

Skytap – Cloud-Based Virtual Labs

  

SUN Utility Services

 

Terremark ‘Enterprise Cloud’

    

VMware

  

Gogrid

Cloud Products

December 31, 2008

UniCluster Express in Amazon’s Elastic Computing Cloud (EC2)

 
 
 
This paper documents the process of implementing the open source UniCluster Express software in Amazon’s Elastic Computing Cloud (EC2) web service. Published by one of the leading informatics consultancy and HPC systems integrators, the paper presents step by step instructions for setting up a UniCluster Express cluster service within EC2.

http://www.johnmwillis.com/groundwork/cloud-vendors-a-to-z/:

 

Cloud Vendor Level Type Status Based Off Beta Status Notes
3Tera 3 Server Not a Provider (1) Software Based Production 3Tera does provide hosting however their goal is to be a software solution not a hosting solution
Adobe Air 1 Application Not a Provider Backbone TBD Desktop play
Akamai 0 Server Not a Provider Software Based Production CDN
Amazon EC2 2 Server Provider Backbone Beta
Amazon S3 2 Storage Provider Backbone Beta
Amazon SimpleDB 2 Database Provider Backbone Beta
Apache CouchDB 2 Database Not a Provider Software Based Production IBM is involved
Apache Hadoop 2 Database Not a Provider Software Based Production
Areti Internet 0 Application Provider 3Tera Production
Box-Net 1 Storage Provider Backbone Production
Cassatt Corporation 0 Server Not a Provider Software Based Production Provisioning play
Citrix (XenSource) 0 Utility Not a Provider Software Based Production
CohesiveFT 1 Utility Not a Provider Amazon EC2 Beta Supports XEN and VMWare
Dell DCS 2 Server Provider Backbone TBD
Elastra 1 Server Provider Amazon EC2 Beta
EMC Mozy 1 Storage Provider Backbone Production Cloud Services Play
Enki 1 Server Not a Provider 3Tera Production Heavier as a services player
Enomaly 1 Server Not a Provider Amazon EC2 Beta Heavier as a services player
Enomoly ElastcDrive 1 Storage Not a Provider Amazon EC2 Beta
EnterpriseDB 1 Database Not a Provider Amazon EC2 Beta Have a cloud offering
Flexiscale 2 Server Provider Backbone Production UK Based
Fortress ITX 1 Server Not a Provider 3Tera Production
Google Apps 1 Application Provider Backbone Beta Desktop play
HP AiaaS 2 Server Provider Backbone TBD
IBM Blue Cloud 0 Server Provider Backbone TBD Provisioning play
iCloud 1 Application Provider Backbone Production Desktop Cloud
Joyent 2 Server Provider Backbone Production Solaris based cloud
JungleDisk 1 Storage Not a Provider Amazon EC2 Beta Low cost utility for S3
Layered Technology 1 Server Provider 3Tera Production A 3Tera mega partner
LongJump 1 Database Not a Provider Amazon EC2 Beta
Microsoft SSDS 1 Database Provider Backbone TBD Competes w/Amazon SimpleDB
MorphExchange 1 Utility Not a Provider Amazon EC2 Beta Ruby on Rails cloud
Mosso 2 Server Provider Rackspace Production Owned by by Rackspce
Rackspace 0 Server Provider Amazon EC2 Production
Rightscale 1 Server Provider Amazon EC2 Beta
Salesforce.com 0 Application Provider SaaS Production
Sun Caroline 2 Server Provider Backbone TBD
Sun MySQL 1 Database Provider Backbone TBD Not sure of plans
Terremark 0 Server Provider Backbone Production
VMWare 0 Utility Not a Provider Software Based Production

Level Description
0 Cloud Look-Alike
1 Cloud Guests
2 Cloud Hosts
3 Cloud Disruptor

 

Qlayer

 
 
 
Q-layer provides software for data centers that enables true cloud computing. Cloud computing is rapidly changing the computing landscape – by turning data center infrastructure into an agile services delivery platform. New services such as virtual servers, storage or applications are available on-demand to both technical and non-technical users, with usage-based chargeback. By leveraging and augmenting existing data center infrastructures including all popular Hypervisors, Q-layer provides enterprises and service providers with the ability to deliver IT services simply and with dramatically lower TCO.

 

 

Bungee Labs – Platform-as-a-Service

 

 
 

GigaSpaces XAP for Amazon EC2

Eucalyptus (Open Source)

 
 
 
EUCALYPTUS – Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems – is an open-source software infrastructure for implementing “cloud computing” on clusters. The current interface to EUCALYPTUS is compatible with Amazon’s EC2 interface, but the infrastructure is designed to support multiple client-side interfaces. EUCALYPTUS is implemented using commonly-available Linux tools and basic Web-service technologies making it easy to install and maintain.

 

 

Desktone

 
 
 
The Desktone Virtual-D Platform is the only solution that enables desktops to be delivered as an outsourced, subscription service. It lets enterprises quickly realize the full potential and benefits associated with virtual desktop infrastructure (VDI) environments – dramatically reduced deployment complexity; improved management, security and compliance; and customizable end-user experiences – without the capital expense and complicated systems integration of building and deploying a customized internal solution.

 

Cycle Computing

 
 
 
Cycle Computing: Easy Grid Computing with Condor

Kaavo

Hadoop (Open Source)

 

Cohesiveft

 
 
 
Cohesive Flexible Technologies enable customers to build and manage custom applications for virtualized infrastructure. As a result of major trends like SOA, Virtualization and Cloud Computing, the approach to data centers is undergoing rapid change, with major ramifications on cost and business agility. CFT provides on-demand automation solutions to enable this transition in a de-risked, stable way.
Our solution, Elastic Server On-Demand, is a cost-effective, automation solution that enables customers to gain business advantage from new opportunities in data center computing, reducing application infrastructure complexity while increasing agility and customer control. Our Elastic Server On-Demand simplifies the process of creating application stacks for use in virtual environments.

10gen

 

Enomalism (Open Source)

 
 
 
Enomalism is an open source web-based virtual infrastructure platform. Designed to answer the complexity of managing globally disperse virtual server environments. Enomalism helps to automate the transition to a cloud computing environment by reducing an IT organizations overall workload. The easy to use dashboard can help with issues including deployment planning, load balancing, automatic VM migration, configuration management, capacity diagnosis and resource monitoring/metering.

3leafsystems

 

RightScale

 
 
 
RightScale’s automated cloud computing management system helps you create scalable web applications that run on Amazon’s Elastic Compute Cloud. Our advanced auto-scaling and load balancing features ensure your site’s uptime and reliability. The RightScale Dashboard makes it easy to setup, launch, and monitor all of your EC2 and AWS activities.

elastra

December 29, 2008

elastra-logo VISION: ELASTIC COMPUTING

Elastic Computing is an evolutionary concept that effectively harnesses the power of software and hardware computing resources available to today The creation of massive, scalable,internet-sized applications now becomes possible at a Total Cost of Ownership that is dramatically lowerthan any traditional data center, or hardware-only cloud-based deployment can achieve. Elastic Computing also aims to improve the application development life-cycle by proposing a methodic and disciplinedapproach to complex, heterogeneous system design and deployment. It allows applications to be developed more quickly and readily accommodate future change in policy and architecture. It engages the application developer to focus on building applications rather than spending his time specifying the underlying application platform.A Superset of Utility Computing
Elastic Computing not only leverages the value of Utility Computing, but also overcomes its shortfalls and thengoes beyond. In essence, Elastic Computing is a synthesis of evolutionary concepts that have emerged on the enterprise computing scene over decades prior, adding the missing components that are essential to fulfill the promise of a true on-demand application computing stack at pay-per-use prices. The resulting value of Elastic Computing is enormous. Key benefits include:

• Up and down scalability of both infrastructure software and hardware resources to manage the peaks and troughs that are typical of real-world application usage patterns. In addition, automated system deployment, scaling and monitoring of this infrastructure allows application developers and supporting IT personnel to focus on higher value-add areas within the application life-cycle.

• Decoupling the application design specification from the deployment specification to (a) drive best practices in system architecture and design, (b) enable experimentation with system design and testing as a  whole, (c) allow the application to leverage software improvements as they emerge, and (d) simplify support for versioning and application migration.

• On-demand utility pricing, which delivers a sensible approach to pricing that gives CPU, storage and bandwidth a normalized unit of measurement that incurs accumulative charges based on actual usage. The net result is that Elastic Computing delivers a seamlessly scalable application infrastructure stack that allows organizations of all sizes to quickly and easily plug their applications in to available Utility Computing environments on a pay-per-use basis.

DEFINITION:Elastic Computing is a business software model which combines new ways of designing, provisioning, scaling, and pricing both infrastructure software and the underlying hardware resources to speed-up and reduce the costs and complexity of the application development, deployment and management life-cycle. By combining infrastructure software and utility computing with new resource management and automation software, a complete, on-demand application infrastructure stack is created which can power dynamically-scalable software applications at pay-per-use prices.

Elastic Computing: The Next Generation of IT InfrastructureElastic Computing is an evolutionary idea whose time has not only come, but also has had to come as a result of major changes in the information technology environment. Picking up where Utility Computing leaves off, Elastic Computing empowers organizations to:Whether the infrastructure is for web-based application production environments, testing and QA environments, data warehousing, or internal productivity applications, new applications can be launched and optimized for today needs and expand to meet the variable and potentially uncertain loads in the future — to be scaled up AND down over time.

 • Manage the peaks and troughs of real-world application usage with up and down scalability of all resources

 • Automate system deployment, scaling and monitoring  Decouple the application system design and development process from the application deployment process

 • Use these utility environments for applications in a way that reflects real-world usage with on-demand, pay-per-use pricing With Elastic Computing, applications can expand and contract automatically based on required load, while minimizing both the human and computing resources consumed. Gone is the need for large capital and human resource investments to make the application software and hardware infrastructure available at-will. This means that the barrier to entry for building, deploying and maintaining applications is dramatically lowered, and remains lowered throughout the application life-cycle.

 Elastic Computing allows the real promise of utility environments to be fulfilled: buying resources in smaller, ondemand pieces is not sufficient. Organizations need to be able not only to buy resources in efficient, smaller pieces, but also to use them in a way that easily responds to elastic demand, without the burden of deploying, scaling and managing the complex environments in which these resources run.

 

 

 elastic_computing_v2_sm1

 

 Industry-standard database and application infrastructure in the Cloud that is:

  • Easily architected, configured and deployed in a complete, clustered, run-time environment
  • Elastically scaled with automated system monitoring and management
  • Priced pay-for-use
  • Delivered on-demand

 

 

 

Links

December 29, 2008

 

 

elastra-logo1Provides companies building applications a way to radically innovate how they develop their products and deliver them on IT infrastructure. The customers shorten their application life-cycles, and bring better products to market more quickly and efficiently, while gaining better utilization of both infrastructure software and hardware. We enable our customers to do this by significantly simplifying and automating how they architect, deploy, manage and pay for their database and application infrastructure.

Hosting

gridlayerThe GridLayer (TGL) is a brand of Layered Technologies that delivers Virtual Private Datacenters and virtual private servers from grids of commodity servers.   TheGridLayer solutions allow hosting resellers, SAAS providers, Web 2.0 companies, small and medium businesses to enjoy the business-building benefits that come with top-notch hardware and transport usually reserved for large enterprises.

 

1800hostingSince 1999, 1-800-HOSTING has been offering end-to-end hosting solutions for companies of all sizes and in all industries. Company’s mission is to provide innovative and reliable fully-managed and semi-managed dedicated hosting services combined with fast, competent and friendly technical support.

 

agathongroup_logoAgathon Group knows grid hosting. In addition to what you’d expect – decades of experience, world-class data centers, and a rock-solid network – Agathon Group offers a number of perks you won’t find anywhere else: the industry’s first AppLogic-based LAMP and Ruby applications; a flexible approach to designing your own application package; a true passion for what we do. And best of all, a real human being at the other end of every phone call.

 

areti_logoAreti Internet Ltd. provides managed hosting solutions across the globe with data centers in London, GB, Manchester, GB and New York City, USA. The company offers flexible in our hosting solutions and will tailor its services according to customer’s needs.

 

cleargridCleargrid offers clients in Singapore grid hosting solutions ranging from grid Virtual Servers and grid Virtual DataCenters to satisfy client’s demand for highly reliable hosting services. With Cleargrid innovative Infrastructure 2.0 service, hosting resellers, SaaS providers, Web 2.0 companies, small and medium businesses can now enjoy the business-building benefits that come with hardware and service usually reserved for large enterprises. Cleargrid is service by Clearmanage, Singapore, a provider of reliable, professional, enterprise-class hosting environments and engineering services to host websites, email, business applications, and other rich media content.

 

dnseuropeDNS Europe Ltd is a pan-European IP communications business that offers clients across Europe services and solutions ranging from grid hosting, outsourcing, ISP systems integration to product development and constultancy. Headquartered in London (UK) with dedicated support resources in SE Europe, we provide secure, resilient data centre hosting through our partners Level(3), Interxion and EUnet.

 

xseedXseed Co., LTD provides high-level IT service using open source software. With more than 300 customers in Japan, Xseed offers hosting services and focuses on system integrators and distributors of mobile-content (music, picture, game and animation). Since august, 2008 Xseed delivers grid hosting service “myDC” based on AppLogic by 3tera targeting companies that need fast and easily scalable platform for applications.

 

Integrators

 

 

 

 

 

 

    Net One Systems logo Net One Systems is Japan’s largest network integrator. The company is continually searching and scrutinizing most advanced technologies to provide highly reliable high value added comprehensive solutions that include consultation, designing, deployment and management services. This is made possible through Net One Systems’ technical center for technology research, quality control center for inspection of both incoming and outgoing products, and network academy for providing engineering education. As of June 2008 Net One Systems is AppLogicâ„¢ exclusive distributor for the Japanese market. 

     ENKI logo ENKI is a Managed Services Provider (MSP) that allow your company to focus on delivering value to your customers. The company offers and supports scalable Virtual Private Datacenters based on 3Tera’s groundbreaking AppLogic Grid Operating System. It offers full network monitoring with dashboard reporting, network design and build, bandwidth provisioning, network and applications security and performance consulting, and enterprise backup solutions. ENKI’s premiere product, the Computing Utilityâ„¢ , wraps these services into a single one-stop solution for businesses who need the performance and flexibility of their own build-to-order (BTO) data center. 

     EnterpriseWizard logo Founded in 1991, EnterpriseWizard Inc is the leading vendor of adaptive Support, Change Management, Asset Tracking and Sales Automation solutions. The company’s outstanding success rate for on-time, on-budget deployments has attracted thousands of customers, ranging from startups to Fortune 100 companies. With it’s uniquely adaptive technology, EnterpriseWizard is the only company able to offer fixed-price implementations backed by an unconditional guarantee of success, even for the most sophisticated deployments. The software features a graphical workflow editor, business rules and email automation, granular permissions, time-keeping, WMI integration, graphical charts/reports, and a full audit trail for government compliance and ITIL support.    

 

 Nirvanix logo

 

  Nirvanix is the premier “Cloud Storage” platform provider. Nirvanix has built a global cluster of storage nodes collectively referred to as the Storage Delivery Network (SDN), powered by the Nirvanix Internet Media File System (IMFS). The SDN intelligently stores, delivers and processes storage requests in the best network location, providing the best user experience in the marketplace. With the ability to store multiple file copies in multiple geographic nodes, the SDN enables unparalleled data availability for developers, businesses and enterprises.

3Tera

December 29, 2008

3tera-logo Provisioning and deployment of  scalable clustered applications from anywhere in the world.

3Tera’s  AppLogic enables:

  • Deployment of scaleble applications in hours without even changing code
  • Provision, monitor and manage operations with just a browser
  • Scale from a fraction of a server to hundreds of CPUs in days

AppLogic is a grid operating system which enables cloud computing for running and scaling web applications.  AppLogic is vendor-neutral. It uses advanced virtualization technologies to be completely compatible with existing operating systems, middleware and web applications. With AppLogic you can package an entire N-tier application or service into a logical entity and manage it as a single system.

Utility computing can be used in different ways depending on your business:

  • Package applications for on-demand delivery
  • Deploy your applications on prepackaged infrastructure
  • Scale your online service without building a multi-tenant system
  • Develop new web applications
  • Build custom N-tier application infrastructure

Package applications for on-demand delivery

AppLogic allows you to run many instances of one or more prepackaged web applications. This enables selling access to high-value on demand applications such as CRM, E-mail, VoIP PBX and many others.  AppLogic makes it easy to create a copy of the desired application for each customer, configure it with an IP address and hardware resources, and have it running within minutes – without operator involvement.

Deploy your applications on prepackaged infrastructure

Pick a standard infrastructure assembly from the catalog, copy your HTML files, scripts code and database onto the logical volumes and start your application. The catalog assemblies are built by IT experts and ready for production deployment.


Scale your online service without building a multi-tenant system
 

Not only is this a great way to scale your service (and, therefore, your business!), but the resulting system is much more resilient than a large, complex multi-tenant application. In AppLogic each application instance carries it’s own infrastructure, such as databases and application servers so a failure affects only a single customer.

Build custom N-tier application infrastructure

Using the AppLogic visual infrastructure editor and the catalog of virtual appliances, you can assemble, configure and troubleshoot your system visually. Integrations that took weeks can be done in hours.

 Managed hosting providers

Companies with expertise operating data centers can use AppLogic to expand existing hosting offerings with pre-packed complex environments. Plus, AppLogic’s ability to scale applications easily provides low entry prices and easy upsell for new services. 

Software-as-a-service (SaaS) companies

Software firms developing new web applications can minimize their go-to-market cost using AppLogic’s ability to copy, deploy and maintain hundreds of instances of their application. 

AppLogic – User Interface

To achieve true utility computing, operators must have as much (or more) control of applications running in their virtual private datacenter as they have today in colo or in their own facilities:

Application Monitoring

Trying to monitor the operation of distributed applications has been an art in itself. To make operations as transparent as possible, AppLogic includes an integrated monitoring system that makes hundreds of counters available for building custom dashboards.

 Hardware Configuration

An AppLogic grid consists of two or more commodity servers connected via an Ethernet network. Each server has two Ethernet ports, a gigabit port which is connected to a network that forms the grid backbone, and a second port connected to the rest of the datacenter and/or the public Internet. The backbone network is private, secure and provides non-blocking gigabit connectivity between any two servers. A standard AppLogic software image is installed on each server before adding it to the grid. One of the servers is designated as a grid controller and runs the management portion of the system. The operator manages the grid by accessing the controller through a secure browser connection.

Cloudware – Cloud Computing Without Compromise

The Web has succeeded by allowing individuals and companies to add their own unique capabilities to The Net. Cloud Computing should develop the same way. Developers shouldn’t be forced to compromise on the selection of development platforms, software, or security. Cloudware is an architecture intended to provide an open framework allowing the development of a cloud computing environment that’s rigorous enough to take on any web or enterprise application.

cloud-computing

Cloudware incorporates the fundamental building blocks used in developing today’s most popular applications; storage and computing, software catalog, definition and control, plus how they all relate to each other. More importantly, the architecture is vendor agnostic so that third party vendors, not just 3tera, can participate in the system. The Cloudware architecture supports the most popular operating systems – Linux, Solaris and Windows – and is targeted toward clients who want to explore the extreme scale and flexibility of cloud computing infrastructures quickly and easily..

Utility computing

Utility computing has sparked imaginations with visions of pay-as-you-go billing, and dynamic resources for years. The concept is simple; rather than operating servers, businesses subscribe to a utility computing service and pay for the resources they actually use. Despite significant R&D investments, though, most vendor offerings fall far short of these ideals.

Bringing Open Source Online

The rapid adoption of software as a service creates a huge opportunity for open source software, and utility computing can be a tremendous enabler for this market shift. Online users are willing to pay for service, whether the code is open source or proprietary. A growing set of companies is addressing this market for hosted applications like Asterisk, SugarCRM, vtiger, Drupal and Zimbra.

The challenge is scaling

  • A team to support users, provides bug fixes and build new features
  • IT infrastructure and systems (billing, ticketing) for delivering the app
  • A sales and marketing team to sign up customers
  • A low entry price per user
  • Improved performance to high-end customers

Most open source applications are not multi-tenant, meaning each user has a separate copy of the application that must be provisioned and managed individually. This can hinder hosting providers from offering a low entry price. Many applications also don’t scale beyond a single server, which makes it difficult to attract business customers.

Utility computing scales existing open source applications

AppLogic makes it easy to package existing open source applications and run them on grids. This removes the need to make the application multi-tenant and enables hosting providers to price it on a pay-as-you-go basis. Hosting providers can fully automate the deployment of thousands of instances of an application and AppLogic will actually maintain all of them. Plus, each instance can be scaled from a fraction of a CPU to dozens with a single command, enabling upselling of customers as their needs grow.

Opportunity to build a scalable open source business

AppLogic makes getting applications online easy for both the development team and hosting providers. For the team, this expands the available market 20x by reaching the 95% of potential users who don’t have the skills to set up applications. Ultimately, this means the ability to generate incremental, ongoing revenue from every user of the application.

Utility Computing for Software-as-a-Service

Although much of the attention focuses on the low entry cost for users and subscription revenue stream for providers, the viability of SaaS really stems from the fact users simply prefer SaaS applications. Operating the application themselves, allows SaaS providers to focus on the user experience rather than on the IT team who installs and maintains the application. Salesforce.com and Webex have proven SaaS is a viable business model and inspired a wave of change in the software industry.

 

AppLogic Technology in a Nutshell

AppLogic is a grid operating system for scalable web applications and services. AppLogic runs distributed transactional and streaming applications on grids of commodity hardware. It does not require a SAN or other expensive shared storage, and is open and vendor-neutral. What’s more, AppLogic is completely compatible with existing web applications. AppLogic is the first grid operating system that is designed for web applications and is optimized for transactional and I/O intensive workloads.

tech-overview

 

 The system runs on a hardware grid assembled from commodity servers connected via Gigabit Ethernet interconnect. Some (or all) of the servers are expected to have directly attached storage – inexpensive IDE/ATA/SATA hard drives which AppLogic uses to provide a distributed storage pool for applications. AppLogic includes three major subsystems:

  • Distributed Kernel – abstracts and virtualizes the grid hardware, and provides core system services
  • Disposable Infrastructure Manager – handles the infrastructure for each AppLogic application
  • Grid Controller – provides a central point for managing and monitoring the grid.

Together, these three subsystems provide the foundation for executing and scaling existing web applications on grids of commodity servers.

The architecture of AppLogic is unique in four important aspects:

1.   AppLogic makes Linux and Windows an integral part of the infrastructure: The conventional approach requires every new OS to implement a set of API to which applications must then be written or ported. AppLogic uses virtualization to enable each disposable infrastructure component to run on its own copy of Linux or Windows and focuses on providing the abstractions and services needed at the distributed application level.

2.   AppLogic makes infrastructure an integral part of each application: Traditionally, you have to build a common infrastructure from firewalls, load balancers, web servers, application servers, database servers, etc. and then deploy multiple applications on it. The use of disposable infrastructure enables AppLogic to reverse this process and include the infrastructure required to run a given application within the application.

3.   AppLogic treats distributed applications as first-class objects: AppLogic treats the entire N-tier application as a single logical entity that can be copied, instantiated, configured, started, stopped, cloned, exported, imported, etc. As a result, once the application has been integrated and tested, it can be manipulated with remarkable ease.

4.   AppLogic is a grid operating system for web applications: These capabilities enable AppLogic to provide the core set of functions that are essential for running mainstream web applications. Those include:

  • Ability to aggregate commodity servers into a single scalable grid
  • Native support for transactional and I/O intensive workloads
  • Allowing an unmodified application to run on different grids
  • Concurrent execution of multiple unrelated applications each with its own resource quota
  • Scaling applications from a fraction of a server up to the full resources of the grid
  • Supporting hardware, middleware and applications from a variety of vendors

In addition, AppLogic implements a number of key services that enable the building of real-world utility computing systems. These include:

  • Resource Metering System – enables pay-per-use models
  • Catalog Delivery System – handles the global distribution and sharing of infrastructure, prepackaged applications and software updates
  • Grid Management System – manages a datacenter as a single system

AppLogic System Services

The AppLogic Distributed Kernel provides a set of system services required to implement the distributed infrastructure and application model of AppLogic. The three most important system services include:

  • Global Volume Store (GVS)
    GVS implements a new type of distributed storage subsystem that combines the advantages of a global file system with an object store. The key object supported by GVS is a virtual volume. Virtual volumes exist in a hierarchical name space, can be created, destroyed and cloned on demand, and are mirrored on multiple servers for read performance and availability.
  • Distributed Virtual Machine Manager (DVMM)
    The AppLogic distributed virtual machine manager is built on top of the Xen hypervisor, the leading open source server virtualization technology. DVMM extends Xen to grids, providing ability to create a virtual machine anywhere on the grid, guarantee hardware resource assignment for each VM, and schedule sets of virtual machines across the grid.
  • Logical Connection Manager (LCM)
    The logical connection manager implements a key service that abstracts intercomponent communications. It enables AppLogic to define all interactions between components of an application in terms of point-to-point logical connections between virtual appliances. The interactions are controlled and tunneled across physical networks, allowing AppLogic to enforce interaction protocols, detect security breaches and migrate live TCP connections from one IP network to another transparently. 

What others say about 3Tera:

  1. http://www.readwriteweb.com 3Tera, a company based in California, has announced what it calls a breakthrough technology – “disposable infrastructure”. This technology is the foundation of their product AppLogic, which they say is the “first grid operating system that runs and scales existing web applications.” It almost takes a Comp Sci PhD from Stanford to read 3Tera’s press release, but in a nutshell what AppLogic does is allow Web companies to manage – and scale – all their applications, servers and storage with just a browser.  The term for this is ‘utility computing’, aka ‘on-demand computing’. It means that a service provider makes available computer resources to their clients and charges them for the usage rather than the hardware. Kind of like a public utility such as your electricity company. Read/WriteWeb contributer Alex Iskold called this ‘Compute Services’ in his recent Web Platform Primer post.  >> Read More
  2. http://gigaom.com  Virtualization holds lots of promise: Move your physical machines to virtual ones, and you’ll reclaim capacity at the same time that you make operations easier. But applications seldom run on one machine; instead they’re a combination of servers, switches and routers. 3Tera’s recently announced product road map may let companies provision whole data centers atop cloud grids like Amazon’s EC2. Call it a Virtual Data Center.    “Most large-scale systems, in order to move up the ladder and serve more customers, require more and more resources,” said Bert Armijo, 3Tera’s VP of product and marketing. “If you manage them as individual virtual machines, the problem is that the human load — the ability to actually remember what’s running where and to manipulate it all — becomes overwhelming. At some point, somebody makes a very small mistake that results in a very large outage.” 3Tera’s Applogic makes software that runs on a grid of hardware: A flat array of commodity servers, Gigabit Ethernet and direct-attached storage. The software turns this into a resource pool that can be provisioned to users. A graphical front-end, called an infrastructure editor, lets administrators drag and drop data center components like firewalls and load balancers. >> Read More
  3. http://www.theregister.co.uk When 3Tera was launched back in 2004, one of the big buzzwords was utility computing, which had just trumped grid computing as the hot new thing. Today, we have cloud computing, and that’s the word so many companies – including 3Tera – are wrapping their marketing efforts around. But 3Tera and its AppLogic virtual infrastructure management tool keep doing what they’ve always done, even as the buzzwords change. The AppLogic tool is used to virtualize Linux and Solaris instances on x64 iron and manage the processor, memory, network, and storage capacities of the underlying hardware as a giant pool of computing. The processor and memory virtualization is done through the use of the open source variant of the Xen hypervisor, and 3Tera invented its own I/O and network virtualization software because back in 2004, there weren’t any commercial alternatives for x64 servers. (Some say, there still aren’t, but Xsigo has some neat I/O virtualization going on). >> Read More
  4.  http://blogs.zdnet.com 3Tera, which provides utility computing services and applications to provision, manage and monitor infrastructure via a browser, will announce Wednesday plans to lay the groundwork for a new architecture for the cloud.3Tera will outline its vision at the Web 2.0 conference in San Francisco…. Bert Armijo, co-founder and senior vice president of sales, marketing and product management at 3Tera, says Cloudware is an attempt to create a “cloud computing delivery network” that would allow various computing efforts–from the likes of Salesforce.com, 3Tera, Amazon Web Services, HP and Google to name a few–co-mingle. >> Read More

Follow

Get every new post delivered to your Inbox.