Sticking your nose in the tinderbox


Once you tell tinderbox to build a list of ports it happily goes off and does it's work. But how do you know what it is doing? Well let's nosey around and see what we can find. Let's open a terminal and tell it to compile devel/p5-Log-Dispatch and see what happens.

[tinderbox/scripts] # compileport -B 9.0 -A amd64 -C clang -P devel/p5-Log-Dispatch ********** ********** Starting tinderbox compiles with - ***** Base versions - 9.0 ***** ARCH list - amd64 ***** Compilers - clang ***** Ports to build - devel/p5-Log-Dispatch ********** ********** Adding port/s to datastore... ********** Compiling devel/p5-Log-Dispatch in 9.0-amd64-clang ********** tinderbuild: creating makefile... tinderbuild: Creating build directory for 9.0-amd64-clang 9.0-amd64-clang: cleaning out /usr/local/tinderbox/9.0-amd64-clang makeBuild: extracting jail tarball tinderbuild: Finalizing chroot environment ================================================ building packages (phase 0) ================================================ started at Tue Oct 16 19:51:03 CST 2012 ended at Tue Oct 16 20:14:51 CST 2012 phase 0 took 00:23:48 26 packages built 15M of packages ================================================ building packages (phase 1) ================================================ started at Tue Oct 16 20:14:51 CST 2012 ended at Tue Oct 16 20:14:51 CST 2012 phase 1 took 00:00:00 26 packages built 15M of packages tinderbuild: Cleaning up after tinderbuild. Please be patient.

Well that doesn't tell me much of anything. In fact during the wait between line 26 and 27 it gives no clue as to what it is doing. It turns out if you look inside the right build dir you will get some more info. With BUILDNAME=9.0-amd64-clang

[local/tinderbox] # ls -l /usr/local/tinderbox/builds/$BUILDNAME total 142 -rw-r--r-- 1 root wheel 14862 16 Oct 19:50 Makefile -rw-r--r-- 1 root wheel 0 16 Oct 19:50 duds -rw-r--r-- 1 root wheel 0 16 Oct 19:50 lock -rw-r--r-- 1 root wheel 37211 16 Oct 20:08 make.0

That lock file tells tinderbox that this build is busy working. In case of severe breakage you will need to delete this to get started again. The duds file contains a list of ports that it won't be compiling (back to that in a sec). The Makefile has a list of dependancies for the port that is being compiled and the make.0 (and make.1 if it is there) is a log file giving a general overview of what is happening, you will see the environment settings and the current port being made (at least the distname of the source package which often matches the portname). tail -f make.0 will let you watch as things progress. make.0 logs stage0 progress while make.1 logs stage1.

If wou want to see more detail then you will find the working system installed inside /usr/local/tinderbox/$BUILDNAME Of most interest will be the tmp dir where you will find pieces of log files that will be joined into the final log that you can access later. Each step of the build is in a separate piece so you get one for extract, one for patch, one for configure...

[local/tinderbox] # ls -l /usr/local/tinderbox/$BUILDNAME/tmp total 2149 drwxr-xr-x 2 root wheel 2 16 Oct 19:51 depends drwxr-xr-x 3 root wheel 3 16 Oct 19:51 distfiles lrwxr-xr-x 1 root wheel 18 16 Oct 19:51 make.log -> perl-5.14.2_2.log2 -rw------- 1 root wheel 577 16 Oct 19:51 make.log1 -rw------- 1 root wheel 190 16 Oct 19:51 make.log2 -rw------- 1 root wheel 1433 16 Oct 19:51 make.log3 -rw------- 1 root wheel 291603 16 Oct 19:53 make.log4 -rw------- 1 root wheel 208061 16 Oct 20:04 make.log5 -rw-r--r-- 1 root wheel 217 16 Oct 19:51 mtree.buildexclude -rw-r--r-- 1 root wheel 412258 16 Oct 19:51 mtree.prebuild -rw-r--r-- 1 root wheel 258 16 Oct 19:51 mtree.preexclude -rw-r--r-- 1 root wheel 409514 16 Oct 19:51 mtree.pristine drwxr-xr-x 2 root wheel 2 16 Oct 19:51 packages -rw-r--r-- 1 root wheel 3117 16 Oct 19:51 perl-5.14.2_2.log -rw-r--r-- 1 root wheel 293831 16 Oct 19:53 perl-5.14.2_2.log2 -rw-r--r-- 1 root wheel 0 16 Oct 19:53 pkgs_post_test -rw-r--r-- 1 root wheel 0 16 Oct 19:53 pkgs_pre_test -rw-r--r-- 1 root wheel 2 16 Oct 19:51 status

Now why would tinderbox list ports in the duds file and how do you build a port that gets listed there? Well the duds file contains ports that are marked BROKEN or IGNORE. For the reason and a way to find a solution you probably need to look inside the Makefile for that port (within the ports tree). There are several reasons for a port to be marked as broken, sometimes it is broken for a specific ARCH, sometimes it is because it is incompatible with another installed port or that two options are incompatible with each other. This would be more likely if you are configuring options for your ports rather than just the defaults. A port may also be marked as ignore if an option is turned on but the supporting port is not installed. While normally that is handled by the ports dependencies I have found at least one port that breaks with that inside tinderbox. It appears that the Makefile is parsed before the dependencies are in place. Also if you set options and create a dependancy loop the make.0 in the builds dir will quickly grow to several gigabytes in size. Killing the make process will then start stage 1 repeating the same thing. The quick growing log size is the only way I found to spot this - well you probably notice the constant disk access slowing things down if you are using the machine at the time. If you use zfs setting a quota on the filesystem for tinderbox can be very helpful.

Inside /usr/local/tinderbox/logs/$BUILDNAME you will find log files of every build that has finished. If there was any errors you will also get a link inside /usr/local/tinderbox/errors/$BUILDNAME

find /usr/local/tinderbox/errors -name "*.log" will list all error logs.

With the default config of tinderbox the webui is turned on. If you turned it off because you don't want apache installed then choose one of the smaller web servers as the webui is helpful. The webui is accessed from http://localhost/tb - if setup on your current machine. If you setup and use tinderd then you can also get access to that through the webui. That includes adding ports to the queue.

The homepage gives a nice table listing each build name with a range of counts for number of ports, failed ports etc and a link to the packages directory. If your building to create your own packages site then you can use this link. While most descriptions for the counts are pretty obvious, unknown status is a count of ports you have added to the datastore but there is no data available for it - the data is only added to the database after the first compile runs. The remake count is how many ports are currently queued to be compiled. Using the example above - when starting to compile devel/p5-Log-Dispatch there is a total of 25 dependancies that need to be installed for that port. When you start the compile on a clean build remake will start at 25 and count down as each dependant port is completed. Ports that need to be updated will also be included in this number. While remake is only a displayed number, the others are links to a list of details.

Most of the other pages are lists that vary only in the search criteria and are pretty straight forward. The latest builds page is good to keep open while building - while a port is compiling it will refresh every minute so you can watch the progress - more helpful when you have a lot of dependancies. A green filled box for reason is no errors, red means failed build and orange means a dependancy failed. The link to show the log file with markup is also helpful - it is pretty good at locating errors in the log files and gives you a list of links at the top to each error line as well as highlighting them in red.


411 comments

dien dan rao vat ho chi minh's picture

This is very interesting, You are a very skilled blogger.
I've joined your rss feed and look forward to seeking more of your wonderful post.
Also, I have shared your site in my social networks!

tickle's picture

Thanks for a marvelous posting! I really enjoyed reading it, you can be a great author.
I will always bookmark your blog and will often come back very soon.
I want to encourage you to ultimately continue your
great writing, have a nice afternoon!

sorry jack 1 hour's picture

It's going to be finish of mine day, however before ending I am reading this impressive paragraph to increase my know-how.

dien dan rao vat uy tin's picture

Good day! I simply wish to offer you a big thumbs up for your great information you have right here on this post.
I'll be returning to your blog for more soon.

garcinia slim fast review's picture

There's definately a great deal to learn about this issue.
I really like all the points you made.

apliques de pared's picture

Muchas gracias por dar a todos una fantastica posibilidad como para leer los comentarios criticos de este weblog.

Up Skin Review's picture

Hi, i think that i saw you visited my blog so i came to
"return the favor".I'm attempting to find things
to improve my website!I suppose its ok to use a few of your ideas!!

endure beauty review's picture

I savour, result in I discovered exactly what I
used to be looking for. You have ended my four day long
hunt! God Bless you man. Have a great day. Bye

animals's picture

Hello it's me, I am also visiting this web page regularly, this web site is really good and the people are really sharing fastidious thoughts.

custom t shirts no minimum's picture

Thank you, I have just been looking for information about this subject for a while and yours is the best I have discovered so far.
But, what in regards to the conclusion? Are
you sure concerning the source?

www.criotecna.it's picture

So now the Complete Pantry and Belle Gibson have been accused of taking
money they raised for charities.

dermakin review's picture

My relatives all the time say that I am
killing my time here at web, but I know I am getting knowledge all the time by reading such fastidious articles.

le jeune's picture

I'd like to find out more? I'd care to find out more details.

Garcinia world's picture

Having read this I thought it was very enlightening.
I appreciate you spending some time and effort to put this content together.
I once again find myself spending a lot of time both reading
and commenting. But so what, it was still worth it!

Garcinia Forte Review's picture

Great work! This is the type of info that are meant to be shared around the internet.
Disgrace on Google for not positioning this submit upper!
Come on over and discuss with my website . Thanks
=)

gibson online guitar lessons's picture

Gibson has partnered with Legacy Learning Methods, the
producer of the Learn & Grasp Guitar course,
to create the Gibson Be taught & Master Guitar App.

vita cream reviews's picture

Hi there, You've done an excellent job. I will certainly digg it and personally recommend to my friends.
I am confident they'll be benefited from this site.

click here's picture

Hello! I could have sworn I've been to this blog before but
after checking through some of the post I realized it's new to me.
Nonetheless, I'm definitely happy I found it and I'll be bookmarking and checking back frequently!

Green Coffee Body Pro's picture

Hello mates, how is the whole thing, and what you desire to
say regarding this piece of writing, in my view its genuinely remarkable in support of me.

one click loan's picture

Do you have a spam problem on this blog; I also
am a blogger, and I was wanting to know your situation; we
have created some nice practices and we are looking to swap techniques with other folks, please shoot me an e-mail if
interested.

Dr. Sherri Worth as herself's picture

Greate pieces. Keep posting such kind of info on your page.
Im really impressed by it.
Hello there, You have done an incredible job. I will certainly digg it and in my opinion recommend to my friends.
I am confident they will be benefited from this site.

local seo services's picture

I was recommended this website via my cousin.
I'm not sure whether or not this submit is written via him as nobody else recognize such certain about my
trouble. You are incredible! Thank you!

by contrast Mark Dubowitz's picture

My partner and I absolutely love your blog and find a lot of your
post's to be just what I'm looking for. Does one offer guest writers to write content for you?
I wouldn't mind publishing a post or elaborating on many of the subjects you write
concerning here. Again, awesome website!

http://astuce-gamer.com's picture

On hawaiian isle off of the coast of North America, local residents simultaneously fight a zombie epidemic while
longing for a cure to come back their un-dead relatives to their human state.
Wide affiliations really allot power staff to keep up
affiliations that are dividing to the survival of a business.
Online games need to be viewed with a critical eye.

left handed electric guitars's picture

Expertise The Wizard of Waukesha" Exhibit at the Waukesha County Museum within the birthplace of Les Paul, Waukesha, Wisconsin.

optimum garcinia Diet's picture

Howdy! Someone in my Myspace group shared this site with us so I came to take a look.
I'm definitely enjoying the information. I'm book-marking
and will be tweeting this to my followers! Great blog and fantastic design.

Donette's picture

With the higher income from his salary as compared to a student who only received allowances, he began to increase his bets; sometimes going as high as a few hundred dollars per stake (his salary was only about 2.
You are the one that controls your fate and the winning numbers are your fate.
Some Asians prefer the long tedious hours playing
Mahjong while others gamble heavily on Toto or more
popularly known as Lotto in Europe.

philanthropy with Luke Weil's picture

Hi, I check your blogs daily. Your writing style is awesome, keep doing what you're doing!

tshirt transfer paper's picture

I'm truly enjoying the design and layout of your blog.

It's a very easy on the eyes which makes it much more pleasant for me to come here and
visit more often. Did you hire out a developer to create
your theme? Great work!

service office's picture

We absolutely love your blog and find nearly aall of your
post's tto bee just what I'm looking for. can you offer guest
writers to rite content available for you? I wouldn't mind producing a post oor elaborating onn a number of the subjects you write about here.
Again, awesome web log!

My blog post - service office

forskolin belly buster review's picture

Woah! I'm really digging the template/theme of this site.

It's simple, yet effective. A lot of times it's hard to get that "perfect balance" between user friendliness and visual appeal.
I must say you've done a fantastic job with this.
In addition, the blog loads extremely fast for me on Internet
explorer. Exceptional Blog!

la lumieres Serum's picture

Hi! This is kind of off topic but I need some advice from
an established blog. Is it very difficult
to set up your own blog? I'm not very techincal but I can figure things out pretty quick.

I'm thinking about setting up my own but I'm not sure where to start.
Do you have any ideas or suggestions? Thank you

Billig Internet By Call's picture

Be sure you enter the cellphone quantity and handle where you intend
to make use of your DSL service.

Synergy Life cambogia's picture

You can definitely see your expertise in the work you write.

The world hopes for even more passionate writers like you who aren't afraid
to say how they believe. Always follow your heart.

internet marketing history's picture

Flat warts are also removable with over the counter products.
Individuals with a weak immune system have increased risk for warts returning.
Warts in clusters is really unsightly, embarrassing and could be really painful.

airsoft guns's picture

Good information. Lucky me I ran across your website by chance
(stumbleupon). I've book-marked it for later!

http://nebuloussaga944.page.tl/Tight-Aggressive-No-Limit-'s picture

Greetings I am so excited I found your webpage, I really found you by accident, while I was looking on Askjeeve for something else, Anyways I am here now and would just like to say kudos for
a tremendous post and a all round interesting blog (I also love the theme/design), I don't have
time to read through it all at the moment but I have saved it and also included your RSS feeds,
so when I have time I will be back to read a great deal more, Please do keep up the fantastic work.

custom t shirts cheap's picture

I like the valuable info you provide in your articles.
I'll bookmark your weblog and check again here regularly.

I'm quite sure I'll learn many new stuff right here!
Good luck for the next!

teaching cockatiels to talk's picture

It's not too no problem finding valuable material but this surely
qualifies as one. Leaving pleased and will undoubtedly return shortly!

Enduros Testo Booster's picture

I read this post completely concerning the resemblance of most recent and preceding technologies, it's amazing
article.

Mark Dubowitz has claimed's picture

Hey I know this is off topic but I was wondering if you knew of any widgets I could add
to my blog that automatically tweet my newest
twitter updates. I've been looking for a plug-in like
this for quite some time and was hoping maybe you would have some experience
with something like this. Please let me know if you run into anything.
I truly enjoy reading your blog and I look forward to your
new updates.

up sweatshirt's picture

Wow that was unusual. I just wrote an incredibly long comment but after I clicked submit
my comment didn't show up. Grrrr... well I'm not writing all that over again. Anyways, just
wanted to say fantastic blog!

create your own shirt's picture

Everyone loves what you guys are usually up too.
This kind of clever work and reporting! Keep up the awesome works guys I've added
you guys to our blogroll.

custom t shirt's picture

What's up i am kavin, its my first occasion to commenting anywhere, when i
read this paragraph i thought i could also make comment due to this brilliant piece of writing.

Luigi Wewege's picture

With havin so much written content do you ever run into any problems of
plagorism or copyright infringement? My site has a lot of unique content I've either
created myself or outsourced but it seems a lot of
it is popping it up all over the internet without my authorization. Do you know any techniques to help reduce content from
being ripped off? I'd definitely appreciate it.

projectyourself.cq491.com's picture

I'm not certain if that demands you to be signed up with
Amazon just before. But it's some thing new.

source's picture

Hey just wanted to give you a quick heads up. The text in your content seem to be running off
the screen in Firefox. I'm not sure if this
is a format issue or something to do with web browser compatibility but I figured I'd
post to let you know. The design and style look great though!

Hope you get the problem fixed soon. Many thanks

keratin smoothing's picture

Excellent post. I was checking constantly this blog and I'm
impressed! Very useful info specially the last part :) I care for such information a lot.
I was looking for this certain info for a long time.
Thank you and best of luck.

pro gain's picture

An intriguing discussion is worth comment. I think that you should write
more about this issue, it might not be a taboo matter but generally people don't talk about such issues.

To the next! Best wishes!!

http://soundfoundry.co/buy-gibson-pickups-review-now's picture

The proprietor of Black Beauty was Tom Doyle,
Les Paul's lengthy-time guitar tech, friend and sound man.

Pages

Add new comment