» tagged pages
» logout

(Feed found, click Add Page to syndicate.) Error finding feed, please try again » Find feed title

A Blog Page allows you to add entries, for news or other time sensitive postings

(Login required to save to your tagged pages.)
(or Cancel)

Make further edits, (or Cancel)

(Login required to save to your tagged pages.)
(or Cancel)

(Editing anonymously: to be credited for your changes, login or register a new account)

Change Page Permissions? Changing these permissions will adjust who can modify this page.

Anonymous (change)
(change)
(or Cancel)
Upload an image from your computer:
or Copy an image from a URL:
or Erase the current icon:
Icon Preview:

or Cancel

Erase high? The contents of high page and all pages directly attached to high will be erased.

or Cancel

(Editing anonymously: to be credited for your changes, login or register a new account)

other page actions:
high

high

sorted by: recent | see : popular
Content Tagged High

High Performance MySQL Second Edition Schedule

I just got the rest of the production schedule from the publisher, plus the PDF files for quality control, for our upcoming book. (Now I have to proofreeed the whole book!) This is the first time I’ve seen the entire production schedule. The book is supposed to go to the printer in the first week of June. I don’t know what the on-the-shelf date will be, but I think very shortly after that. The publisher has promised that it’ll physically be on sale at Velocity.

I also took a peek at the PDFs. Without the appendixes, the last page of Chapter 14 (Tools for High Performance) is page 604. The appendixes bring it to 660 pages. That’s real material, not including tables of contents and indexes. So my estimate (620) was not too far off.

660 pages is not bad, considering that the contract was for 384 pages.

Another note: the marketing materials for the book emphasize that it covers MySQL 5.1. While this is true, I want to point out that we took a real-life approach: we write about what we’ve seen in the real world, and 5.1 is not as widely deployed in the real world. However, the book’s real value, as far as version-specific content goes, is its tremendous depth and breadth in MySQL 4.1 and 5.0. These have been “out there” for a long time, and among the four of us we’ve seen about every conceivable scenario with it. So you’ll get a lot of insight about current, production-ready, widely-used versions. Let the other guys speculate — we just report the facts. It’s not like there’s any shortage of things to say about 5.0, right?

MySQL: Planet MySQL

Come to beCamp 2008

I’m going to be at beCamp 2008, the followup to the first beCamp, which I sadly missed.

beCamp is a BarCamp un-conference. Tonight was about meeting, greeting, and throwing ideas at the wall to see which ones stick. Literally. We stuck pieces of paper on the wall with our ideas — things we can either talk about or want to hear about — and then scratched our votes on them to see which are popular.

I live and breathe MySQL for a decent part of the day, so I hesitated, but then stuck “MySQL Performance” on the wall. It got quite a few votes, so I assume will be giving a talk on MySQL performance basics at some point during the conference. (The exact schedule is probably being determined right now, in my absence, but I’m so tired right now that I’ll just take my chances on it not being at 8:00 AM tomorrow.) [edit: I just checked the website and there won’t be anything before 9:00, and the schedule is determined tomorrow. I did say I’m tired, right?]

See you there!

PS: if you want to meet some of my colleagues from my former employer, the Rimm-Kaufman Group, they’ll be there too, wearing the “We’re Hiring” t-shirts. They’re hiring, by the way.

, , , ,

MySQL: Planet MySQL

Pre-Order High Performance MySQL Second Edition

High Performance MySQL

If you’re waiting for High Performance MySQL Second Edition to hit the shelf, you’re not the only one. I am too! I can’t wait to actually hold it in my hands.

But you don’t have to wait idly. No, not at all! You can pre-order it and then you’ll get it as soon as possible. Plus your pre-order will help them figure out how much demand there is, so it doesn’t sell out and make you wait for your own copy.

No Tags

MySQL: Planet MySQL

Spring 2008 issue of MySQL Magazine

Keith Murphy and his hard-working crew have released the spring 2008 issue of MySQL Magazine. Go take a look — it includes quite a few articles on various topics, even a mention of our upcoming book (High Performance MySQL, Second Edition).

, ,

MySQL: Planet MySQL

MySQL Conference Liveblogging: Optimizing MySQL For High Volume Data Logging Applications (Thursday 2:50PM)

  • http://en.oreilly.com/mysql2008/public/schedule/detail/874
  • presented by Charles Lee of Hyperic
  • Hyperic has the best performance with MySQL out of MySQL, Oracle, and Postgres in their application
  • I suddenly remember hyperic was highly recommended above nagios in MySQL Conference Liveblogging: Monitoring Tools (Wednesday 5:15PM)
  • performance bottleneck
    • the database
      • CPU
      • memory
    • IO
      • disk latency
      • network latency
    • slow queries
  • media size deployment example
    • 300 platforms (300 remote agents collecting data)
    • 2,100 servers
    • 21,000 services (10 services per server), sounds feasible
    • 468,000 metrics (20 metrics per service)
    • 28,800,000 metric data rows per day
    • larger deployments have a lot more of these (sounds crazy)
  • data
    • measurement_id
    • timestamp
    • value
    • primary key (timestamp, measurement_id)
  • data flow
    • agent collects data and sends reports to server with multiple data points
    • server batch inserts metric data points
    • if network connection fails, agent continues to collect but server "backfills" unavailable
    • when agent reconnects, spooled data overwrite backfilled data points (why not use REPLACE for all inserts?)
  • things are very basic so far
  • batch insert
    • INSERT INTO TABLE (a,b,c) VALUES (0,0,0), (1,1,1),…
    • using MySQL batch insert statements vs prepared statements with multiple queries in other databases seems to improve overall performance by 30%
    • batch inserts are limited by 'max_allowed_packet'
  • other options for increasing insert speed
    • set unique_checks=0, insert, set unique_checks=1 (definitely need to make sure data is valid first)
    • set foreign_key_checks=0, insert, set foreign_key_checks=1 (same concerns as above)
    • Hyperic doesn't use the 2 above
  • INSERT … ON DUPLICATE KEY UPDATE
    • when regular INSERT fails, retry batch with INSERT ON DUPLICATE KEY syntax
    • it's much slower but it allows
  • this is all basic, where are the performance tweaks?!
  • batch aggregate inserter
    • queue metric data from separate agent reports
      • minimize number of inserts, connections, CPU load
      • maximize workload efficiency
    • optimal configuration for 700 agents
      • 3 workers
      • 2000 batch size seems to work best
      • queue size of 4,000,000
    • this seems to peak at 2.2mil metric data inserts per minute
  • data consolidation
    • inspired by rrdtool
    • lower resolution tables track min, avg, and max
    • data compression runs hourly
    • size limit 2 days
    • every hour, data is rolled up into another table that holds hourly aggregated values with size limit 14 days, then that one gets rolled up into a monthly table, etc
    • this is is a good approach if you don't care about each data point
  • I'm overwhelmed by the amount of "you know"s from the speaker. Parasite words, ahh! Sorry Charles )
  • software partitioning
    • measurement data split into 18 tables, representing 9 days (2 per day)
    • they didn't want to do more than 2 SELECTs to get data per day, hence such sharding
    • oddly, Charles didn't actually use the word 'shard' once
    • tables truncated, rather than deleting rows => huge performance boost
    • truncation vs deletion
      • deletion causes contention on rows
      • truncation doesn't produce fragmentation
      • truncation just drops and recreates the table - single DDL operation
  • indexes
    • every InnoDB table has a special index called the clustered index (based on primary key) where the physical data for the rows is stored
    • advantages
      • selects faster - row data is on the same page where the index search leads
      • inserts in (timestamp) order - avoid page splits and fragmentation
    • shows comparison between non-clustered index and clustered index (see slides)
  • still no mention of configuration tweaks
  • UNION ALL works better than inner SELECTS because the optimizer didn't optimize them enough (at least in the version these guys are using, not sure which)
  • recommended server options are on the very last slide, I was waiting for those the most! I guess I'll look up the slides after
Similar Posts:

MySQL: Planet MySQL

Get a free sample chapter of High Performance MySQL Second Edition

If you’re at the MySQL Conference and Expo, you can get a free sample chapter of the upcoming High Performance MySQL Second Edition. Just go to the exhibition area. As you go through the doors, take an immediate left and look for the sample chapter on O’Reilly’s table. It’s a rough draft and contains typos and my incredibly crude drawings instead of those that will go into the final book, but it should serve to give you an idea of the book’s depth and scope. Kudos to Andy Oram, our editor, who was able to get these done for us on very short notice.

,

MySQL: Planet MySQL

A different angle on the MySQL Conference

There are quite a few business angles you might see only if you’re here at the conference, and you won’t get from blogs. For example, let’s take a look at the contents of the shoulder bags they hand out with your registration. (This is only a partial list.)

  • SnapLogic’s flyer gets it right: their system is compatible with “GNU Linux.” Hooray, a commercial company acknowledging the GNU operating system for what it is!
  • MySQL Enterprise’s flyer has three big bullet points: MySQL Load Balancer, MySQL Connection Manager, and MySQL Enterprise Monitor Query Analyzer. The first two look like they’re probably built on MySQL Proxy. The last has a visual explain plan feature, which according to an elevator conversation is not yet built. I’ll stop by their booth and see. As you may know, Maatkit has provided a tool (which is designed for integration into other tools) that shows a visual explain plan for a long time.
  • There’s an issue of Linux Journal, which does not get the GNU part right. And it has no articles about MySQL. Off-topic! Discarded!
  • Infobright’s flyer says they can load data nearly real-time. I don’t know how you read it, but to me that says “can’t quite keep up with how fast you generate data.” So… what good can it possibly be, right?
  • The conference bag itself has Zmanda’s logo on the side.
  • Webyog’s flyer has one side for SQLyog, and one for MONyog. Each side takes the sparse but visually appealing approach of shiny icons to present a feature list. My favorite is the “Find slow SQL” turtle.
  • JasperSoft’s flyer has soothing, professional blues and rich reds. It makes them look very trustworthy. (I’m not being snarky.) And they have lots of nice whitespace. It’s a little bit of a different look.
  • Kickfire’s marketing department is really on the ball. I’ve seen a large number of flyers and other materials from them (online and offline) and they just changed their name and created a new logo and look-and-feel a short time ago. How do they do it so fast?
  • O’Reilly has a bunch of half-sized flyers for their conferences. We should have asked them to throw in one about our upcoming book, the second edition of High Performance MySQL. Alas, opportunity lost. By the way, stop by the bookstore and grab a copy of the sample chapter.
  • Zmanda, not content with stamping the outside of the bag, has a half-flyer inside it too, plus a chance to win a Digital Rebel to lure you to their booth. If you’re doing backups the way a lot of people seem to, you might want to stop by their booth anyway…
  • There’s a CD for a free trial of WinSQL. But the CD case doesn’t say what the

Sorry. I have a short attention span.

, , , ,

MySQL: Planet MySQL

Replication is dead, long live Replication!

Brian Aker has found general agreement with his post: "The Death of Read Replication".

Arjen Lentz says "I think Brian is right...", and Frank Mash confirmed: "what Brian says about replication, caching and memcached is very true".

Just like Video killed the Radio Star it looks like maybe Memcached killed the Replication Hierarchy!

But of course, Brian and others are talking about replication for scaling reads.

In my session on PBXT next week at the conference I will be talking about how we plan to use synchronous replication to produce an HA solution for MySQL at the engine level.

I will also discuss how some flexibility in the PBXT architecture makes it possible to actually scale writes efficiently as mentioned by Arjen in his blog.

So don't miss it:

Inside the PBXT Storage Engine
10:50am - 11:50am Thursday, 04/17/2008
Ballroom G

PrimeBase-XT: PBXT Blog

IOPS in a Very High-End NFS Environment?


Since I’m on site at a Beta customer (testing the product I work on at Oracle), this will be a quick blog entry. I’ve been meaning to direct folks to Gear6 for quite some time now. I have no stake in Gear6, so this is not a shameless plug. I think they solve interesting problems so if you are a large NFS shop, I’d recommend checking them out. They offer a plug-in NFS read-through cache and while I haven’t had first hand experience with their product, I know folks that have and they had good things to say about Gear6.

If any of you are confused about what NFS has to do with Oracle, I recommend this list of Oracle on NFS related posts.

Oracle: Kevin Closson's Oracle Blog

User:seoanand

Hi.. i’m Anand : i’m having good dynamic, pleasant personality and make friends at instance. As per professional ways, i’m keen to do innovative and challenges work. I’m very good at communicating with others.

Please join in my network and tag my websites, they are very useful

Education In Germany | Higher Education Consultant | Study Abroad in Germany
Comprehensive german language programs provides learning of german language, education consultants india, study abroad in germany, Study German In Germany.

Learn Search Engine Optimization Tactics
Search engine optimization (SEO) is to about marketing. SEO also known as SERP (Search engine rank positioning) is basically a plan to increase a sites visibility, selecting keywords that will generate the targeted traffic.

Training Manual for Software Testers
Software testing is process of systematically running software system or program to uncover errors or defects, test case design, review of test case design, recording testing results, review, sign off of testing results, defect reporting.

Sugar Daddy Dating | Alternative Lifestyle Bisexual | BDSM Dating | Gay Dating | Lesbian Dating | Nylons Fetish, Submissive | Transsexual, Millionaire Dating
Altsugardaddy.com is a sugar daddy dating website which is offering adult dating services including, bisexual dating, bdsm dating, bondage dating, dom sub, fetish personals, gay dating services, lesbian online dating, millionaire dating services, nylons fetish, pantyhose fetish, submissive dating, transsexual dating and other alternative lifestyles.

Free Online Dating Websites | Christian, Jewish Singles | Herpes Dating | STD Personals | Disabled singles
Connectioncove.com is a free online dating website, Providing services for everyone in addition to being a quality site, we have information and forums for disabled singles, HPV dating, herpes dating, std personals, Jewish dating, Christian singles.

Temecula Portal | Business Directory | Community, Schools, Real Estate, Casinos, Weddings, Wines, Shopping, Festivals, Movies, Hotels, Restaurants
Find what you are looking for in the Temecula Valley Area with LoveTemecula.com – temecula portal, business directory, community, schools, real estate, casinos, weddings, wines, shopping, festivals, movies, hotels, restaurants.

Indian Real Estate | Buy, Sell, Rent Commercial & Residential Properties | Ahmedabad | Mumbai | New Delhi | Banglore | Pune | NRI Property
We offer real estate solution to investors for the best properties in India and international nri property, ahmedabad, mumbai, new delhi, banglore, pune, gurgaon, noida, jaipur, hyderabad, goa, baroda, lonavala, australia, uk, london, dubai. Buy, sell, rent and lease commercial & residential property, pent house, flat, individual house, bungalow, farm house, villa, office complex.

Overseas Education Consultants | German Language Programs | Education Consultants India | Study Abroad in Germany
Calculus is the largest german and overseas education consultants in india. our comprehensive german language programs provides learning of german language, education consultants india, study abroad in germany.

Montreal Escorts | Escorte Montreal | Escort Montreal Incalls | Montreal Sexy Escort Services
HC-Escorts provides high class montreal escort services, our escorts services include hot and young girls from various ethnic, origins, be it french, asian, british, or american, montreal sexy escort, escort montreal incalls, contact us today to experience the top seed escorts.

Birth Control, Birth Control Pills & Patches, Emergency Pills
Birth control pills and patches are necessary to stop unwanted or unplanned pregnancies. Know the complete information on birth control, birth control pills & patches, drugs, oral contraceptives, emergency pills, side effects, methods and options.

High Performance MySQL 2nd Edition is in production

Just a quick note to say we have reached the production stage of the book project. Production is the process of transforming our OpenOffice.org files into the final page layout using a professional typesetting program.

As you can probably guess, this is later than we would have wished. This also means we won't have the book for sale at the upcoming MySQL Conference and Expo. We will have a display copy at the O'Reilly booth at the conference, and you will be able to pre-order the book at a discount at that booth. (Several details remain to be worked out -- do not trust the Amazon.com information on the book, as it is a weird blend of the first and second editions).

The book is very, very good. You will not be disappointed. I can't think of a credible way to explain how good this book is -- it's just very, very good. Better than anything else you've ever read on the subject. So good that you will not want to share, because you'll want to have your own copy handy for frequent reference (I currently refer to the OpenOffice.org files several times a week myself, and I wrote them!). But I'll let you see for yourself. Buy a copy for yourself, your boss, your coworkers, and your mom. And your cat.

MySQL: Planet MySQL

online homework helper

Inspiring online homework helper site, easy analysis

User:rick.klaus

Fascinating online homework helper forum, good discussion

You Too Can Find A Nanny – Find Your How To’s Here!

Your other children might be in high school, or you are considering getting a baby sitter on a daily basis to help you out in and around the house, with the kids, as you get ready to go back to work full-time and you are left with trying to find a nanny.

Page 1 | Next >>
Username:
Password:
(or Cancel)