MySQL databases are increasingly used by high volume, high transaction applications
that support businesses running full throttle 24-hours a day, seven days a week.
Backup and recovery operations need to be conducted in such as way that is non-disruptive
to users and applications. The latest release of Zmanda Recovery Manager (ZRM) 2.2 provides
Continuous Data Protection (CDP) as well as instant point-in-time recovery for MySQL.
In this webinar, we will demonstrate the latest ZRM enhancements so that you can use ZRM
to build a robust, flexible, and easy to use backup and recovery solution.
When: Thursday May 29, 2008, 10:00am Pacific / 1:00pm Eastern
Ask any DBA what are his top priorities for backup of MySQL. Chances are that hot backup and recovery to a specific point-in-time (or transaction) will be on top of everybody?s list.
The recovery to any point-in-time has been always an ultimate goal for data protection. Traditional backup solutions allow recovering only to a point in time when the last backup took place, e.g. last night. A lot of new data could be created and lost since that last backup. That is why in the last several years many vendors have been working on Continuous Data Protection (CDP).
Storage Networking Industry Association (SNIA) defines Continuous Data Protection (CDP) as “a class of mechanisms that continuously capture or track data modifications enabling recovery to previous points in time”.
ZRM 2.2 enables CDP by using LVM, VxFS, VSS, ZFS and NetApp snapshots in conjunction with MySQL transaction logs. When doing a recovery to a particular point in time, ZRM reads data from the snapshot and then replays MySQL transaction log from that point forward. This enables almost instantaneous point-in-time recovery.

For each point in time T, ZRM creates a snapshot that includes a MySQL binary log. To recover MySQL database to a specific Recovery Point Objective (RPO) between T2 and T3, ZRM reads data from snapshot T2 and replays transactions from binlog T3 up to RPO providing the user with point-in-time recovery. To enable instantaneous recovery snapshots are stored where the database files are, for example, on the same NetApp filer.
Since real life recoveries are performed under stressful conditions, we designed our product to simplify your life and ensure successful recovery:
Some CDP solutions capture all writes to the database effectively duplicating what a binary log is designed to do. Why re-invent the wheel and waste computing resources? ZRM is integrated with MySQL on a deeper level than any other backup solution. That allows us to provide very efficient CDP solution with almost instantaneous point-in-time recovery.
——
Dmitri Joukovski
Final slides from keynote delivered this morning at the MySQL user conference. Topic was protecting live MySQL databases.
(Slides render well in both OpenOffice and PowerPoint)
No, this is not a blog about Computational Fluid Dynamics - my least favorite subject in college. This is about a more exciting (sorry mechanical engineers!) CFD: Customer Facing Data. This is the data that is typically available on the website of an organization that their customers interact with. CFD can range all the way from profiles of users on a social networking site such as Facebook to the customer information database of an e-commerce company such as Travelocity.
CFD represents today’s data protection challenge. Probably the biggest challenge while planning a backup solution for CFD is that it is very hard to figure out what to plan for. You might be starting with a very small database which might grow much more rapidly than what you think. If the data can be segmented based on users or some other characteristic, then you will find that your databases may scale-out instead of scale-up. Also, rate of change can be very rapid, sometimes with lots of small changes (e.g. tags) or sometimes with big data changes (e.g. addition of user generated media content), very similar to the rather unpredictable viral growth pattern of the Internet.
Many organizations are keen to save and analyze behavior of users as they interact with CFD. This metadata can itself pose a data protection challenge of its own, since it may change very rapidly, while the actual data is not changing (e.g. tracking of customer intelligence metadata about which prospects downloaded which whitepapers from your corporate website, so that you can determine the best marketing & sales approach for these prospects).
MySQL is the DBMS of choice for CFD. Some skeptical press and analysts have said a few times that MySQL is not being deployed at the back-end of the enterprise (financials, billing etc.), but only on the web-tier. The implicit (sometimes explicit) implication being that web-tier applications are less important for the organization. I think this analysis fails to realize the actual importance of the data being stored in web-tier applications. Most of this is CFD, loss of which will cause huge pain and costs in the form of lost revenues, customers and reputation.
From its very inception, Zmanda has been focused on technologies powering CFD (MySQL, LAMP stack, and now increasingly Solaris). We have dug deeper than anyone else in understanding the needs of protecting this crucial part of any organization and very rapidly delivered products to address these needs. We are the data protection company for CFD. While we do protect back-end applications and platforms, our technology and business focus remains CFD.
I will be talking about deploying radically simple backup solutions for CFD on Thursday (April 17th, 10AM) at the MySQL user conference. I am in the unenviable position of making a Backup presentation sound interesting after the Facebook keynote (”A Match Made in Heaven? The Social Graph and the Database”). Well, I guess the point that conference organizers are trying to make is that if you have a radically simple MySQL backup and recovery solution, you will have more time to spend on Facebook!
Speaking of analysts, I recently read an analyst report which indicates that, on average, salaries offered to MySQL DBAs can be up to 40% lower than those offered to Oracle or DB2 DBAs. This ironically is considered one of the barriers for entry of MySQL in some environments. Per this report: higher paid database personnel have vested interest to keep MySQL out. Another claim is that somehow the lower salary to MySQL DBAs reflects the relative importance of the MySQL powered application for the business. Well if you are a MySQL DBA, you will do well to make your management realize that you are the keeper of their Customer Facing Data. Any business deploys its best resources for customer facing activities. Hopefully this will start reflecting on your paycheck soon.
If you would like to talk about your data protection challenges, or your salary as a MySQL DBA, stop by our booth #307 at the MySQL user conference.
Worried about Backup and Recovery of your MySQL Databases? MySQL Backup school from Zmanda provides hands on and in depth training on Backup and Recovery of MySQL. Just sign up and show up with your laptop. More information available here.
Today Sun and Zmanda announced our agreement to deliver a comprehensive, global data backup and recovery solution for MySQL Enterprise subscribers. Starting April 1st, MySQL Enterprise customers will be able to purchase ZRM for MySQL directly from Sun worldwide.
I think Zack’s comment in the press release captures the rationale for the deal:
“Protecting corporate data through effective backup and recovery is one of the most crucial tasks for a database administrator, and it can be a complex undertaking — especially for today’s large Web-scale applications,” said Zack Urlocker, VP of products, Sun Microsystems database group. “MySQL users have told us that global backup and recovery is very important to them, and we are thrilled that we can now offer ZRM for MySQL as an easy-to-use solution for protecting all of their MySQL data.”
Of course, at Zmanda we are thrilled as well. Sun’s sales channels will give us the opportunity to make MySQL Backups radically simple for ever increasing MySQL installations around the world.
Zmanda has introduced a new version of Zmanda Recovery Manager (ZRM) which adds quite a few capabilities for MySQL users. Version 2.1 includes enhanced snapshot support that enables backup without application downtime or interruption to online data access. Version 2.1 also has global management of backups so that you can manage all your MySQL backup jobs from a single graphical console. You can now run the entire ZRM solution on Solaris as well as on Linux.
Join us for an overview and a live demo of ZRM 2.1 on Thursday 3/20 at 10am PST. Click here to register.
We are hosting a webcast tomorrow to talk about backing up corporate data to Amazon?s Simple Storage Service (S3) using Amanda Enterprise. We will demonstrate live, how enterprise users can now use Amanda Enterprise to harness Amazon S3 for a complete data backup, archiving and disaster recovery solution. The webcast will take place on Wednesday February 13 at 10:00AM PST and will last about an hour, including a Q&A session at the end. We hope you can join us to discover a new & cost effective way to leverage online storage services such as Amazon S3 as a part of your corporate data protection strategy. Click here to register.
Congratulations to Marten and team on Sun’s acquisition of MySQL today! This is a billion dollar stamp of approval on the importance of the LAMP stack. This also gives another strong backing to the business model which involves giving one’s software away for free to up to 99+% of users!
This announcement comes at an interesting time for Zmanda. Just last week we announced support for the Solaris platform for our Amanda Enterprise product line. With our industry leading MySQL backup solution, we now have full coverage of operating systems and database software from the new Sun!
A great day for open source software and business of open source software!
We presented a webinar along with MySQL last week. The topic was MySQL Backup from the perspective of an Oracle DBA. We got some really good questions at the end of the webinar. Here is a transcript of Q&A:
Q from Trey: Will this Webinar be available online for viewing later?
A from MySQL: Yes. It will be on our site in a few days at http://www.mysql.com/news-and-events/on-demand-webinars/
Q from Randy: Is a copy of presentation available on web? Where?
A from Zmanda : slides are available on Zmanda Network: http://network.zmanda.com/
Q from Jing: Converting database from oracle to MySQL, any limitation regards the version compatibility?
A from MySQL: We provide a free GUI migration tool that helps migrate Oracle data objects to MySQL. For a complete and very detailed discussion on the subject, download our white paper on the subject at http://www.mysql.com/why-mysql/white-papers/mysql_wp_oracle2mysql.php
Q from Julien: Is MySQL supported on NetApp?
A from MySQL: Yes
Q from Julien: For mysql on NetApp, which protocols are supported? nfs? iscsi? cifs?
A from MySQL: I believe the key protocols are supported.
Q from Haris: How does ZRM integrate with NetApp
A from Zmanda: ZRM takes advantage of snapshots provided by Data ONTAP OS in NetApp filers.
Q from Jim: Will the “new non-blocking backup utility” for MySQL for hot backup be free? or an extra cost option? Thank you.
A from MySQL: At this time, the core backup utility is planned to be GPL and in the community server
Q from Neil: How much does ZRM cost?
A from Zmanda: Annual subscription starts from $200 per MySQL server. We provide subscriptions with three levels of support — Basic (email only), Standard (business hrs phone and email) and Premium (7 X 24). Pricing is available at www.zmanda.com/pricing.html
Q from Franck: so the licensing is per MySQL Server
A from Zmanda: Yes, subscription is per MySQL server and you can backup as many databases within that server as you have.
Q from Isaac: Is the community edition of Zmanda fully functional or somehow restricted?
A from Zmanda: The Community Edition is fully functional. However, only the Enterprise version provides web-based Management Console that simplifies all operations. It also provides log analyzer that simplifies point-in-time recovery. To see additional details, please check http://www.zmanda.com/zrm-mysql-enterprise.html
Q from Pavel: Does Zmanda GUI manager comes for free???
A from Zmanda: No. Only the Enterprise (which requires annual subscription) version provides a web based console.
Q from Tim: Could you provide onsite support if we need that?
A from Zmanda: Yes. We can provide onsite support and training if needed.
Q from Haijun: Does ZRM include InnoDB online backup?
A from Zmanda: Not in the current release. It is planned for a future release
Q from Alicia: Any idea how long before the release of a ZRM version that supports hot backup of InnoDB databases?
A from Zmanda: 3-6 months (likely next release)
Q from Mike: mysqldump cmdline for non-blocking with innodb?
A from Zmanda: mysqldump –single-transaction is non-blocking for transaction storage engines such as InnoDB
Q from Kevin: Now that Oracle owns the rights for InnoDB, what is it’s future. Will Oracle charge for InnoDB? Is there a replacement for Innodb from MySQL
A from MySQL: For MySQL, it’s business as usual so no changes from a support standpoint. We do have other transactional engines available - NDB (cluster) and our new Falcon transaction engine (about to enter beta). Also we have SolidDB and PBXT, - external engines
Q from Srinivas: what is the dependency of InnoDb during backup process?
A from Zmanda: There is no dependency on storage engines, but we can take advantage on functionality provided with some engines, e.g. we can use mysqlhotcopy as a data extraction utility for MyISAM. Another example — using snapshots with InnoDB can provide truly hot backup of MySQL.
Q from Madhavi: Having a combination of MyISAM and innodb, do we need separate jobs for backups?
A from Zmanda: No, you don’t. ZRM is designed to handle variety of MySQL configurations and the same backup job can handle different engines.
Q from Alicia: Which backup modes of ZRM support Innodb backups?
A from Zmanda: All backup methods are supported with Innodb storage engine (logical, raw, snapshot, replication)
Q from Rich: For datacenters with centralized backup to tape, will ZRM work in this environment? If so, am I able to have each customer have their own tape and can it be incremental and/or full?
A from Zmanda: Absolutely. ZRM can be easily integrated with any enterprise media manager such as Amanda, Netbackup by Veritas, NetWorker by Legato and TSM by IBM. Think of ZRM as “RMAN” for MySQL.
Q from Kevin: With Oracle we use RMAN and Netbackup using scripts for level 0,1,2. Can ZRM do the same?
A from Zmanda: Yes you can. You can use ZRM in conjunction with Amanda Enterprise (network backup software similar to NetBackup). If you are using NetBackup pre-backup and post-backup scripts to integrate with Oracle/RMAN, you can write similar scripts with ZRM.
Q from Charlie: If my 20 backups are successful and usually they are, I don’t want 20 emails. I only want an email if it “fails”.
A from Zmanda: You may have to tailor the email being sent. This can be done with some scripting. We plan to improve this functionality in the next release of Zmanda Recovery Manager for MySQL
Q from Jos: When in a replicated environment, can you restore all replicated databases at the same time from one backup?
A from Zmanda: Yes. You should configure all databases in the same backup set.
Q from Srinivas: Is selective recovery feature allows deselecting the corrupted records ?
A from Zmanda: If you have incremental backups covering the time frame when the records were not corrupted — then yes
Q from Isaac: How is recovery handled with the community edition of ZRM?
A from Zmanda: Recovery in community and enterprise editions is the same. Recovery depends on the backup method used. The DBA does not need to remember the backup method used. Enterprise edition provides easy to use recovery manager in Zmanda Management Console.
Q from Bob: Can Zmanda use multiple streams in parallel to backup a database?
A from Zmanda: You can configure ZRM to backup in multiple streams by configuring tables in the database in different backup sets.
Q from Raju: Can I resume my backup after a failure instead of starting over?
A from Zmanda: If there is backup failure, ZRM uses a different backup method. ZRM uses a hierarchy of backup methods depending on configuration and storage engine in use. Currently we don’t have a built-in checkpoint mechanism to resume a particular failed backup run.
Q from Isaac: Can ZRM be used to take backups from a slave, or is there some writing that is performed during the backup?
A from Zmanda: You can take backup from slaves in a replication setup.
Q from Rich: How does the recovery time compare between ZRM and RMAN for similar sized (say 800GB) DBs?
A from Zmanda: ZRM supports multiple backup methods and multiple storage engines. If you are using InnoDB storage engine (size 800GB) and snapshot backup method, the recovery time will be comparable.
Q from Eric: Does ZRM perform any compression? or encryption options?
A from Zmanda: Yes. ZRM uses plug-in architecture. You can create plug-ins for compression and encryption. The default configuration has lz and bzip2 compression similar to Oracle/RMAN.
Q from Steve: Can ZRM restore a single mysql database if you have it configured to “backup all databases” on a server?
A from Zmanda: Yes.
Q from Adam: So, when I enable the Zmanda backup, should I disable the collection of the binary logs, or can Zmanda use the logs collected by MySQL?
A from Zmanda: Zmanda can use logs collected by MySQL. Binary logs are used for incremental backups.
Q from Rich: what gets installed on the DB - an agent? If so, how lightweight is it?
A from Zmanda: On MySQL server, you need to install small footprint software that does data transfer to the ZRM server. This software runs only when needed (during backup run).
Q from Nitish: how to you integrate third part snapshots methods within zmanda?
A from Zmanda: There is a snapshot plugin interface which is documented in ZRM for MySQL wiki http://mysqlbackup.zmanda.com/index.php/Snapshot_Plugin
Q from Mike: Can you speak more about the feature that will delay a backup during times of heavy usage?
A from Zmanda: This is done using scheduling plugin. Please see ZRM for MySQL wiki http://mysqlbackup.zmanda.com/index.php/How_to_create_custom_plugins_for_MySQL_ZRM%3F#Pre_Scheduler_plugin
Q from Sarah: are zrm and zmc integrated or can they be? or are they completely free standing applications such as rman and netbackup.
A from Zmanda: ZRM can be used without ZMC, but then you loose ease of use and extensive monitoring and reporting available only via ZMC.
Q from Srinivas: does ZRM supports Community Version of MySQL?
A from Zmanda: ZRM enterprise version supports both the community and enterprise versions of MySQL.
Q from Rich: Will ZRM Community work with MySQL Enterprise or is that a licensing restriction?
A from Zmanda: Yes, it will, but we highly recommend to use the Enterprise version of ZRM for Enterprise version of MySQL.
Q from Eric: when is support for Falcon storage engine expected from ZRM
A from Zmanda: Zmanda works very closely with MySQL engineering. We will support Falcon when released and we are already working with alpha version of Falcon.
Q from Greg: What is ZRM’s backward compatibility to previous versions of MySQL? I notice your examples all show MySQL v5.
A from Zmanda: We support all versions from MySQL 3.X. There are restrictions on the backup methods supported in older releases. Please contact zsales (at) zmanda.com if you are interested in compatibility with a particular MySQL release.
Q from Rick: Is ZRM available on Suse?
A from Zmanda:: Yes. It works on SLES as well as Open SuSE
Q from Franck: Do you also support Mac OS X?
A from Zmanda: Yes, remote backup of MySQL on Mac OS X is supported.
Q from Neil: No ZRM for Windows server? Is that correct?
A from Zmanda: ZRM can be used to protect MySQL database on ANY operating system. Some OS are supported in remote configurations only. Windows is supported remotely and we are working on a new version that runs either locally remotely on Windows and uses VSS snapshots for backup of MySQL.
Q from Franck: I’m confused. Is Zmanda a backup solution for Mysql only? Of can it be used to BackUp Oracle too?
A from Zmanda: Zmanda Recovery Manager (ZRM) has been designed specifically for backup and recovery of MySQL. It is closely integrated with MySQL. Think of ZRM as “RMAN” for MySQL.
Q from Alexandre: Our organization has both Oracle and MySQL databases. Can ZRM provide some uniformity in managing both backups, e.g. backup MySQL to the same physical backend tape storage as Oracle?
A from Zmanda: You can backup both to same physical backend by using a third party media manager, such as Amanda Enterprise or NetBackup.
Q from Bob: From a ZRM standpoint is there any difference backing up a MySQL DB on Linux vs. Windows?
A from Zmanda: In current release, we do not support snapshots for MySQL on Windows. The next release will support VSS snapshot method for MySQL on Windows.
Q from Bob: What media managers does Zmanda integrate with?
A from Zmanda: Any media manager, for example Amanda Enterprise, NetBackup, Legato and others.
Q from Alexandre: Are there any competing products on the market to manage MySQL backups?
A from Zmanda: Our competition is adhoc scripts written by MySQL DBA and our own community edition
Q from Adam: I’m a little confused… What is the ZRM DB Event log exactly? Is it like the InnoDB binary logs? What is the format of it?
A from Zmanda: ZRM DB event log is same as MySQL binary log (that is used for MySQL replication). It contains SQL statements and results of SQL statements.
Q from Nitish: who are your major customers?
A from Zmanda: We have organizations of all sizes as our customers ? from large online retailers and airline reservation systems to small manufacturers and research labs. We are where MySQL is run in production and where organizations value their MySQL data. Please send an email to zsales (at) zmanda.com to get a reference list of our ZRM customers.
Q from Neil: Where is Zmanda located?
A from Zmanda: We are in Sunnyvale, CA and Pune, India. Many employees work remotely in different countries.
If you are migrating your production environment to MySQL database or even thinking about it, you do not want to miss this webinar Experts from Zmanda and MySQL will present various methods to backup MySQL database and correlate them with tools and terminology you may be familiar with in other databases, including Oracle.
A good pre-read for this webinar would be Paddy’s blog on online MySQL Backup
Chander Kant, CEO, Zmanda
Robin Schumacher, Director Product Management, MySQL
WHAT:
MySQL Backup Techniques for the Oracle DBA (web presentation)
WHEN:
Thursday, December 13, 2007, 10:00 am PDT, 1:00 pm EDT, 18:00 GMT
The presentation will be approximately 45 minutes long followed by Q&A.
Community version 1.2.1 of Zmanda Recovery Manager (ZRM) for MySQL, a robust and intelligent solution for backup and recovery of MySQL databases is available for download at Zmanda downloads page.
Changes in this release:
For documentation see, ZRM for MySQL users manual. Please use bugzilla to report bugs and feature requests. If you have questions or feedback, please post them in forums.
EBI Neutrino R1 is a Open Source Framework for ERP / CRM
Enterprise Resource Planing (ERP) and Customer Relation Management (CRM) software solution that will combines power of distribution, inventory, E-Commerce, accounting and workflow, within
one robust application. EBI Neutrino is designed customizable for your enterprise and was created to handle the adaptation on any Business requirement.
ERP stands for Enterprise Resource Planning and it is the smart solution to all your business management needs. ERP applications typically consist of modules such as Marketing and Sales, Field Service, Production, Inventory Control, Procurement, Distribution, Human Resources, Finance and Accounting.
CRM stands for Customer Relationship Management. CRM software supports your business process to find, get, and retain customers. CRM applications typically consist of modules such as Sales Force Automation, Call Management, and Self Service
Fatures EBI Neutrino CRM Edition:
EBI Neutrino CRM is a module application that comes with EBI Neutrino Framework package.
With this module you have the best opportunity to create a satisfied and loyal customer base, while CRM (customer relations management) concentrated on the front-office, i.e. the sales effort.
EBI Neutrino CRM is designed with the philosophy that the front-office directly drives the business. Total customer orientation is a must and the entire business needs to support this.
The first sale is made by a sales person, the following sales are made by production, shipping, call centers, accounting. With EBI Neutrino CRM, you always have the 360 degree view for your customer and product related activities enabling one-to-one marketing.
With EBI Neutrino CRM Systems you effort this privileges:
EBI Neutrino R1 is a Open Source Framework for ERP / CRM
Enterprise Resource Planing (ERP) and Customer Relation Management (CRM) software solution that will combines power of distribution, inventory, E-Commerce, accounting and workflow, within
one robust application. EBI Neutrino is designed customizable for your enterprise and was created to handle the adaptation on any Business requirement.
ERP stands for Enterprise Resource Planning and it is the smart solution to all your business management needs. ERP applications typically consist of modules such as Marketing and Sales, Field Service, Production, Inventory Control, Procurement, Distribution, Human Resources, Finance and Accounting.
CRM stands for Customer Relationship Management. CRM software supports your business process to find, get, and retain customers. CRM applications typically consist of modules such as Sales Force Automation, Call Management, and Self Service
Fatures EBI Neutrino CRM Edition:
EBI Neutrino CRM is a module application that comes with EBI Neutrino Framework package.
With this module you have the best opportunity to create a satisfied and loyal customer base, while CRM (customer relations management) concentrated on the front-office, i.e. the sales effort.
EBI Neutrino CRM is designed with the philosophy that the front-office directly drives the business. Total customer orientation is a must and the entire business needs to support this.
The first sale is made by a sales person, the following sales are made by production, shipping, call centers, accounting. With EBI Neutrino CRM, you always have the 360 degree view for your customer and product related activities enabling one-to-one marketing.
With EBI Neutrino CRM Systems you effort this privileges:
Framework
open
and
Windows
CRM
ERP
linux
Software
Java
(c)
The role of data stored in MySQL database in today’s world is already known - it powers business and mission critical apps. Protecting this data is of utmost important to any enterprise. Before you actually have a backup in place, that are some very important things to think about the backup implementation. Like for instance, how soon would you want your data recovered after a user or system error? This article provides an indepth analysis about the basics of what needs to be considered while planning a Backup and Recovery solution for your MySQL database.
Zmanda’s MySQL Backup and Recovery Solution is the only comprehensive backup solution that addresses the unique needs of MySQL databases — such as multiple database storage engines. Zmanda Recovery Manager (ZRM) for MySQL now features graphical tools to simplify the process of protecting MySQL data.
This free presentation from experts in open-source backup and recovery of MySQL will demonstrate Zmanda Management Console for ZRM , which is a web based service integrated with Zmanda Network. It provides management and visualization tools for defining all backup activities of a MySQL DBA:
WHO:
Chander Kant, CEO and Co-Founder of Zmanda
Paddy Sreenivasan,VP of Engineering and Co-Founder of Zmanda
WHAT:
Zmanda Management Console for MySQL Backup web presentation.
WHEN:
Wednesday, August 22, 2007, 10:00 am PDT, 1:00 pm EDT, 17:00 GMT
The presentation will be approximately 45 minutes long followed by Q&A.
Could not resist the title after reading what Matt wrote. Sexy and exciting, indeed. Most of the crew here have their heads buried with the upcoming releases of Amanda Enterprise and Zmanda Recovery Manager (ZRM) for MySQL. We are continuing to enhance the Management console for Network backup. And with the next release of ZRM for MySQL, backup of MySQL database will never be the same. Dmitri already wrote about how easy it will be to manage MySQL backups from Iphone. Additionally we are fixing stuff in the Management console for ease of use. You can see, touch and feel them at LinuxWorld. Come check us out. And watch this space for more excitement !
Version 1.2 of Zmanda Recovery Manager (ZRM) for MySQL, a robust and intelligent solution for backup and recovery of MySQL databases is available at Zmanda downloads page.
Changes in this release:
Documentation is available at ZRM for MySQL wiki. Ask questions and provide feedback in Zmanda forums.
Thanks to everyone who attended the talk in person.
The slides used in the talk is available at ZRM for MySQL wiki
If you have questions or comments, please send them to me.
The value of data stored in LAMP applications is increasing at an exponential pace. Indeed, the LAMP stack fuels an economy of its own - with its own currency, lingo and players. While e-commerce is the clear and present evidence of the LAMP powered economy, the currency for this economy is by no means just monetary. Value is manifested in many factors other than financial gains: personal reputation and legacy, karma points, creativity etc. The LAMP stack fires up innovation by enabling new ideas - you can quickly and cost-effectively prototype a concept which other’s may find bizarre.
User generated content (UGC) is one key currency of the LAMP stack. UGC, even votes (ok, diggs) on other’s UGC store tangible and lasting value. While naming “You”, a proxy for UGC, the Time’s Person of the Year 2006, The Time magazine said: “It’s a story about community and collaboration on a scale never seen before. It’s about the many wresting power from the few and helping one another for nothing and how that will not only change the world, but also change the way the world changes.” With current trends UGC (most of which is stored in LAMP stacks) will continue to pack in increasing value for companies and communities around the world.
Since the cost of deploying applications on the LAMP stack tends to be very low, sometimes their importance to the enterprise may not be perceived accurately. The LAMP stack moves the value of IT infrastructure to business data and applications, which is exactly where it should be (instead of costly underlying technology). The importance of protecting LAMP data can easily be gauged by looking at all LAMP based applications that you rely on. Whether you are using a vBulletin or phpBB based forum for your users, or SugarCRM for your sales force, or Mediawiki for your corporate wiki - loss of data in any of these instances will result in at least lost productivity, if not lost revenue and reputation.
The LAMP economy comes with its own set of challenges and hazards, e.g. crowdhacking, comment storms etc. Dealing with these challenges is especially challenging for IT managers since it is extremely hard to get scheduled downtime on LAMP applications which power a busy website. In addition, such an environment has its own requirements as far as point of time where data should be recovered to (aka Recovery Point Objective). For example, owner of a web based forum may want to recover their data to a point just before a rogue user created a login and started vandalizing the forum.
Several dynamics make data protection for LAMP based applications a more challenging problem than traditional environments. For one, the data stored within LAMP stacks in many cases does not have any physical record. E.g. nobody keeps a printout of all threads in a forum. So, if LAMP data is lost and cannot be recovered, you would simply need to live without that data - there is no way to recreate it from any physical records.
Data in LAMP applications is stored both in MySQL databases and filesystems (typically configuration data). LAMP applications have a tendency to scale out instead of scaling up. One application may be spread across multiple servers (either in form of MySQL Cluster, or simply independent aspects of application distributed on independent LAMP stacks). The application administrator has to take into account multiple servers and locations of their LAMP data while putting together a backup strategy. In such an environment, creating a point-in-time consistent backup is a challenging task.
Frequently, LAMP based applications are hosted at a service provider’s site, instead of a captive data center. This provides additional challenges (and opportunities) for data protection. You will need to carefully plan how the recovery for the whole stack and application will take place at a different location from your hosting provider (e.g. in a hurricane Katrina like situation). In many cases, administrators will need to backup their LAMP data remotely using a secure communication protocol. An interesting alternative here is to use a remote storage grid (e.g. Amazon S3 service) to do the backup of the LAMP applications. Why bother with local tape hardware (and all the idiosyncrasies of tapes), when your data is remote anyway.
It is imperative that today’s IT managers assess the value of data stored in their LAMP stack based applications. They need to architect a backup solution for their LAMP applications based on the impact on application performance, application availability, type of failures to recover from, and the cost of implementing the solution. Administrators need to pay attention to the data in all layers of the LAMP application in order to get a consistent data backup for the whole LAMP application stack.
Zmanda is at an interesting place when it comes to the LAMP stack. We use the LAMP stack in our own products - the new Zmanda Management Console is developed on it, and we are focused on making it simple to protect the value of LAMP application data. Our open source projects extensively use wiki and forums for community collaboration and communication. Our products provide data protection for the entire LAMP stack. Amanda is the leading backup solution for a network of Linux filesystems. Our Zmanda Recover Manager for MySQL product is one of the most popular solutions to backup MySQL databases.
One extensive user of the LAMP stack is Adspace Networks - the largest in-mall digital audio/visual network in the United States. LAMP data is not just displayed on a small browser window - Adspace shows its customer’s advertising artwork on sixty inch plasma displays mounted in 8 foot tall enclosures! Using Adspace’s LAMP based applications, retailers can create new campaigns and upload advertising artwork - which then shows up on the huge screens. LAMP stack enabled Adspace to create and deploy this application in a very aggressive timeframe. Wide availability of LAMP consultants and hosting providers was seen as a big plus while deciding the application framework. Adspace needed a solution which could backup their data more frequently than the traditional nightly backup (due to high value of the customer data). While their applications are deployed at a remote hosting site, they wanted to keep the backup data on their own site. Adspace deployed Zmanda Recovery Manager for MySQL to backup their LAMP data. This solution enabled them to create a consolidated backup solution with point-in-time recovery capability, without having to spend time and expertise in building and architecting a LAMP backup solution.
While Google and Yahoo are the most likely destinations if you want to search for something, if you want to discover stuff one of the coolest destinations is StumbleUpon. StumbleUpon is helping more than 2.1 million users discover and share interesting websites. “Collaborative Opinions” is the currency that StumbleUpon trades in. LAMP stack stores this extremely valuable data of users, their preferences and friends, and all the websites they discover. StumbleUpon stumbled upon Zmanda’s LAMP backup solutions when they were looking to reduce the time and complexity of backing up this data, which is increasing by the minute. The rapid growth of their data mandated incremental backup of their database - full backup every time was just too time-consuming. Today they use Zmanda Recovery Manager for MySQL to backup their database and manage the backed up archives. StumbleUpon implemented Zmanda’s backup solution for its simplicity and effectiveness for their exact needs.
Zmanda is a Diamond sponsor of MySQL users conference. Come Visit us at booth 415.
Various membes of our team are also presenting at the conference. If backup of MySQL databases is
of interest to you, you do not want to miss any of the following presentation:
Zmanda Speakers
Keynote: Data Protection for the LAMP Economy
Presenter: Chander Kant, CEO, Zmanda
Date: Thursday, April 26, 2007
Time: 9:50am-10:20am
Location: Ballrooms E-H
Track: Security & Database Administration
Topic: MySQL Backup: Roadmap & Vision
Presenters: Paddy Sreenivasan, VP Engineering, Zmanda
Lars Thalmann, Replication & Clustering Technology, MySQL
Date: Wednesday, April 25, 2007
Time: 10:45am-11:45am
Location: Ballroom B
Track: Vendor Products & Services
Topic: Zmanda Recovery Manager (ZRM) for MySQL
Presenters: Ram ?TK? Krishnamurthy, VP Services & Support, Zmanda
K.K. George, Director Engineering, Zmanda
Date: Wednesday, April 25, 2007
Time: 3:35pm-4:35pm
Location: Ballroom G
Birds Of A Feather
Topic: Backup and Recovery of MySQL
Track: Storage Engine Development and Optimization
Moderators: Paddy Sreenivasan, VP Engineering, Zmanda
Dmitri Joukovski, VP Product Management, Zmanda
Date: Tuesday, April 24
Time: 7:30pm - 9:00pm
Location: Lafayette