Sticking your nose in the tinderbox


Once you tell tinderbox to build a list of ports it happily goes off and does it's work. But how do you know what it is doing? Well let's nosey around and see what we can find. Let's open a terminal and tell it to compile devel/p5-Log-Dispatch and see what happens.

[tinderbox/scripts] # compileport -B 9.0 -A amd64 -C clang -P devel/p5-Log-Dispatch ********** ********** Starting tinderbox compiles with - ***** Base versions - 9.0 ***** ARCH list - amd64 ***** Compilers - clang ***** Ports to build - devel/p5-Log-Dispatch ********** ********** Adding port/s to datastore... ********** Compiling devel/p5-Log-Dispatch in 9.0-amd64-clang ********** tinderbuild: creating makefile... tinderbuild: Creating build directory for 9.0-amd64-clang 9.0-amd64-clang: cleaning out /usr/local/tinderbox/9.0-amd64-clang makeBuild: extracting jail tarball tinderbuild: Finalizing chroot environment ================================================ building packages (phase 0) ================================================ started at Tue Oct 16 19:51:03 CST 2012 ended at Tue Oct 16 20:14:51 CST 2012 phase 0 took 00:23:48 26 packages built 15M of packages ================================================ building packages (phase 1) ================================================ started at Tue Oct 16 20:14:51 CST 2012 ended at Tue Oct 16 20:14:51 CST 2012 phase 1 took 00:00:00 26 packages built 15M of packages tinderbuild: Cleaning up after tinderbuild. Please be patient.

Well that doesn't tell me much of anything. In fact during the wait between line 26 and 27 it gives no clue as to what it is doing. It turns out if you look inside the right build dir you will get some more info. With BUILDNAME=9.0-amd64-clang

[local/tinderbox] # ls -l /usr/local/tinderbox/builds/$BUILDNAME total 142 -rw-r--r-- 1 root wheel 14862 16 Oct 19:50 Makefile -rw-r--r-- 1 root wheel 0 16 Oct 19:50 duds -rw-r--r-- 1 root wheel 0 16 Oct 19:50 lock -rw-r--r-- 1 root wheel 37211 16 Oct 20:08 make.0

That lock file tells tinderbox that this build is busy working. In case of severe breakage you will need to delete this to get started again. The duds file contains a list of ports that it won't be compiling (back to that in a sec). The Makefile has a list of dependancies for the port that is being compiled and the make.0 (and make.1 if it is there) is a log file giving a general overview of what is happening, you will see the environment settings and the current port being made (at least the distname of the source package which often matches the portname). tail -f make.0 will let you watch as things progress. make.0 logs stage0 progress while make.1 logs stage1.

If wou want to see more detail then you will find the working system installed inside /usr/local/tinderbox/$BUILDNAME Of most interest will be the tmp dir where you will find pieces of log files that will be joined into the final log that you can access later. Each step of the build is in a separate piece so you get one for extract, one for patch, one for configure...

[local/tinderbox] # ls -l /usr/local/tinderbox/$BUILDNAME/tmp total 2149 drwxr-xr-x 2 root wheel 2 16 Oct 19:51 depends drwxr-xr-x 3 root wheel 3 16 Oct 19:51 distfiles lrwxr-xr-x 1 root wheel 18 16 Oct 19:51 make.log -> perl-5.14.2_2.log2 -rw------- 1 root wheel 577 16 Oct 19:51 make.log1 -rw------- 1 root wheel 190 16 Oct 19:51 make.log2 -rw------- 1 root wheel 1433 16 Oct 19:51 make.log3 -rw------- 1 root wheel 291603 16 Oct 19:53 make.log4 -rw------- 1 root wheel 208061 16 Oct 20:04 make.log5 -rw-r--r-- 1 root wheel 217 16 Oct 19:51 mtree.buildexclude -rw-r--r-- 1 root wheel 412258 16 Oct 19:51 mtree.prebuild -rw-r--r-- 1 root wheel 258 16 Oct 19:51 mtree.preexclude -rw-r--r-- 1 root wheel 409514 16 Oct 19:51 mtree.pristine drwxr-xr-x 2 root wheel 2 16 Oct 19:51 packages -rw-r--r-- 1 root wheel 3117 16 Oct 19:51 perl-5.14.2_2.log -rw-r--r-- 1 root wheel 293831 16 Oct 19:53 perl-5.14.2_2.log2 -rw-r--r-- 1 root wheel 0 16 Oct 19:53 pkgs_post_test -rw-r--r-- 1 root wheel 0 16 Oct 19:53 pkgs_pre_test -rw-r--r-- 1 root wheel 2 16 Oct 19:51 status

Now why would tinderbox list ports in the duds file and how do you build a port that gets listed there? Well the duds file contains ports that are marked BROKEN or IGNORE. For the reason and a way to find a solution you probably need to look inside the Makefile for that port (within the ports tree). There are several reasons for a port to be marked as broken, sometimes it is broken for a specific ARCH, sometimes it is because it is incompatible with another installed port or that two options are incompatible with each other. This would be more likely if you are configuring options for your ports rather than just the defaults. A port may also be marked as ignore if an option is turned on but the supporting port is not installed. While normally that is handled by the ports dependencies I have found at least one port that breaks with that inside tinderbox. It appears that the Makefile is parsed before the dependencies are in place. Also if you set options and create a dependancy loop the make.0 in the builds dir will quickly grow to several gigabytes in size. Killing the make process will then start stage 1 repeating the same thing. The quick growing log size is the only way I found to spot this - well you probably notice the constant disk access slowing things down if you are using the machine at the time. If you use zfs setting a quota on the filesystem for tinderbox can be very helpful.

Inside /usr/local/tinderbox/logs/$BUILDNAME you will find log files of every build that has finished. If there was any errors you will also get a link inside /usr/local/tinderbox/errors/$BUILDNAME

find /usr/local/tinderbox/errors -name "*.log" will list all error logs.

With the default config of tinderbox the webui is turned on. If you turned it off because you don't want apache installed then choose one of the smaller web servers as the webui is helpful. The webui is accessed from http://localhost/tb - if setup on your current machine. If you setup and use tinderd then you can also get access to that through the webui. That includes adding ports to the queue.

The homepage gives a nice table listing each build name with a range of counts for number of ports, failed ports etc and a link to the packages directory. If your building to create your own packages site then you can use this link. While most descriptions for the counts are pretty obvious, unknown status is a count of ports you have added to the datastore but there is no data available for it - the data is only added to the database after the first compile runs. The remake count is how many ports are currently queued to be compiled. Using the example above - when starting to compile devel/p5-Log-Dispatch there is a total of 25 dependancies that need to be installed for that port. When you start the compile on a clean build remake will start at 25 and count down as each dependant port is completed. Ports that need to be updated will also be included in this number. While remake is only a displayed number, the others are links to a list of details.

Most of the other pages are lists that vary only in the search criteria and are pretty straight forward. The latest builds page is good to keep open while building - while a port is compiling it will refresh every minute so you can watch the progress - more helpful when you have a lot of dependancies. A green filled box for reason is no errors, red means failed build and orange means a dependancy failed. The link to show the log file with markup is also helpful - it is pretty good at locating errors in the log files and gives you a list of links at the top to each error line as well as highlighting them in red.


415 comments

nitro focus muscle's picture

Hi there just wanted to give you a quick heads up. The words in your content seem to be
running off the screen in Ie. I'm not sure if this is a format
issue or something to do with internet browser
compatibility but I thought I'd post to let you know.
The design and style look great though! Hope you get
the problem resolved soon. Many thanks

Dr Sherri Worth's picture

This info is worth everyone's attention. When can I find out
more?

Jual Beli google cardboard VR Virtual Reality Indonesia 's picture

I like the valuable info you provide in your articles. I will bookmark your weblog and check again here regularly.
I am quite sure I'll learn plenty of new stuff right here!
Best of luck for the next!

kung fu's picture

Fantastic goods from you, man. I have be aware your stuff previous to and
you are simply extremely wonderful. I really like what you
have received right here, certainly like what you are saying and the best
way in which you assert it. You are making it enjoyable and you continue to care for to stay it
wise. I can't wait to learn much more from you. That is actually a wonderful site.

white touch high quality's picture

That is a great tip especially to those fresh to the blogosphere.
Brief but very precise information... Thank you
for sharing this one. A must read article!

leather necklaces medium black's picture

First of all I want to say awesome blog! I had a quick
question in which I'd like to ask if you do not mind.
I was interested to know how you center yourself and clear your thoughts
prior to writing. I have had difficulty clearing my thoughts in getting my thoughts out there.

I truly do enjoy writing but it just seems like the first 10 to 15 minutes tend to be wasted simply just trying
to figure out how to begin. Any recommendations or hints? Cheers!

Brian Poe Lexington KY's picture

Hello, I enjoy reading all of your article post.
I wanted to write a little comment to support you.

cleanse detox's picture

This information is priceless. When can I find out more?

recording studios in Phoenix's picture

I simply couldn't depart your site prior to suggesting that I
actually enjoyed the usual info a person supply to your guests?

Is going to be again continuously to inspect new posts

Jimmy's picture

Software Tailor has been able to work magic for us. They are very talented report writers. I've seen them do things others say can't be done.

Software Outsourcing HK

harvokseclinic.com's picture

Hey there this is somewhat of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with
HTML. I'm starting a blog soon but have no coding experience
so I wanted to get guidance from someone with experience.
Any help would be greatly appreciated!

Biolift Eye's picture

Hmm it appears like your website ate my first comment (it was extremely long) so I guess I'll just sum it up what I had written and say, I'm thoroughly enjoying
your blog. I too am an aspiring blog blogger but I'm still
new to the whole thing. Do you have any helpful hints for beginner blog writers?
I'd certainly appreciate it.

lipo g3 garcinia cambogia's picture

I am curious to find out what blog platform you happen to be utilizing?

I'm experiencing some minor security issues with my latest website and I'd like to
find something more risk-free. Do you have any suggestions?

Pro Lean Cleanse's picture

I believe everything said was actually very reasonable.
But, what about this? what if you added a little information? I am not suggesting
your content isn't solid., however suppose you
added a title that grabbed people's attention? I mean Add new comment | Shaneware.biz is a little vanilla.
You could look at Yahoo's home page and watch how they create post titles to get
people to open the links. You might add a video or a related picture
or two to grab people interested about everything've written. Just
my opinion, it might bring your posts a little bit more
interesting.

organic plants's picture

What's up, I read your new stuff on a regular basis.
Your writing style is witty, keep doing what you're
doing!

Daily Fantasy Sports's picture

Having read this I thought it was extremely informative.
I appreciate you spending some time and effort to put this informative article together.
I once again find myself personally spending a significant amount of time both reading and commenting.

But so what, it was still worth it!

Michael Dinkins's picture

Hi! I underdztand this is kind ?f off-topic but I had to ask.
Doees building a well-esta6lidzhed website such as yours take
a large amount of ?ork'? I'm completely neew too blogging but I do write in my journal daily.
I'd like to dztart a blog so I will be able to dzhsre my pegsonal
experijence and thoughts online. Please let mee kno? if uou have any kind of
recommendations or tips for new aspiring bloggers.
Appreciate it!

Reto 90 testimonio's picture

Keep on writing, great job!

cresa bucuresti militari's picture

Hello! Do yoou use Twitter? I'dlike to follow you if that would be ok.

I'm definitely enjoying your blog and look forward to
new posts.

authors's picture

This article explains the countless benefits of using the Online
Publishing model (OPM). 1) Self-publishing could be the only way to get
published. One in the main difficulty with self publishing is since your manuscript are not held accountable to high editing and evaluation standards this doesn't really help your cause.

gold backed ira cons's picture

Etf Silver Investing And Lessons From Musical Chairs

Forskolin Fit Pro's picture

Thanks for a marvelous posting! I seriously enjoyed reading it, you are a great author.I will remember
to bookmark your blog and will come back in the foreseeable future.
I want to encourage you continue your great posts, have a nice day!

megabauer.tumblr.com's picture

I was suggested this web site by my cousin. I
am not sure whether this post is written by him as nobody else know such detailed about
my difficulty. You're amazing! Thanks!

petsafe wall dog door's picture

It is perfect time to make a few plans for the longer term
and it is time to be happy. I have read this put up and if I
may just I desire to suggest you some attention-grabbing things or advice.

Maybe you could write subsequent articles regarding this article.
I want to learn more things approximately it!

Gluco Health Review's picture

Hi to all, how is everything, I think every one is getting more
from this website, and your views are fastidious designed for
new visitors.

headphones packaging empire hands's picture

I've read several good stuff here. Certainly value bookmarking for revisiting.
I wonder how a lot effort you set to make such a magnificent informative web site.

waist apron apple's picture

Do you mind if I quote a couple of your articles as long as I provide credit and sources back to your website?
My blog is in the very same niche as yours and my visitors would definitely benefit from some of the information you present here.
Please let me know if this alright with you. Cheers!

nature skin labs's picture

Hi Dear, are you truly visiting this web page on a regular basis, if so afterward you will without
doubt get nice experience.

waist apron apple's picture

Do you mind if I quote a couple of your articles as long as I provide credit and sources back to your website?
My blog is in the very same niche as yours and my visitors would definitely benefit from some of the information you present here.
Please let me know if this alright with you. Cheers!

http://geinou.cri.jp/lib/ime.Php?detraplift.blogspot.Nl's picture

Dacht rustig wat hierover tikken. Een paragraaf betreffende de stoel lift.

charlie stripe trooper splendid's picture

What's up, everything is going nicely here and ofcourse every one is sharing data, that's actually fine, keep up
writing.

Elite test 360's picture

Magnificent goods from you, man. I've understand your stuff previous to and you
are just too great. I actually like what you have acquired here, certainly like what you
are saying and the way in which you say it. You make it entertaining and you still take
care of to keep it wise. I can not wait to read far more from
you. This is actually a great web site.

green t shirts's picture

Thanks for a marvelous posting! I seriously enjoyed
reading it, you're a great author. I will make sure to bookmark your blog and will come back down the road.
I want to encourage you continue your great posts, have a
nice holiday weekend!

rubberized shield samsung galaxy's picture

What's up Dear, are you actually visiting this site regularly, if so afterward you will without doubt take
nice know-how.

testerone XL reviews's picture

Everyone loves what you guys are up too. Such clever
work and reporting! Keep up the great works guys I've included you guys to my own blogroll.

Johnk21's picture

I simply couldn't depart your web site prior to suggesting that I actually loved the usual info a person supply for your guests? Is gonna be again continuously in order to check up on new posts. gedbeggekfge

Johnf20's picture

Someone essentially help to make significantly posts I might state. This is the first time I frequented your web page and so far? I surprised with the research you made to create this actual submit amazing. Magnificent activity! edabdcgfbceb

horizontal charger alcatel's picture

certainly like your web site however you have to test the spelling on quite a few of your posts.
Several of them are rife with spelling issues and I in finding it very bothersome to tell the truth however I will certainly come back again.

di perugia burgundy's picture

Great article. I will be dealing with some of these issues as well..

Hoku Serum's picture

Link exchange is nothing else however it is simply placing the
other person's web site link on your page at appropriate
place and other person will also do similar for you.

di perugia burgundy's picture

Great article. I will be dealing with some of these issues as well..

super c shield's picture

Aw, this was an extremely nice post. Finding the time and actual effort to
make a great article... but what can I say... I hesitate a
lot and never seem to get anything done.

renuvaderm review's picture

Hello, constantly i used to check blog posts here
early in the break of day, because i like to learn more and
more.

Moviestarplanet hack v3's picture

When a remedy oriented strategy is used, mainly together with Movie - Star - Planet diamonds,
items can certainly work out a lot better than usual.

Safe mode is a troubleshooting option for Windows that starts your computer in a
limited state and try to determine what is causing it to not
function correctly. It tends to make me better understand their courage and commitment.

french Nails's picture

bookmarked!!, I really like your web site!

seo los angeles's picture

Hi there, I found your website by the use of Google even as searching for a comparable topic, your website got here up, it seems great.
I've bookmarked it in my google bookmarks.
Hello there, just changed into aware of your blog through Google, and found that it's really
informative. I am going to be careful for brussels. I will be grateful if you proceed
this in future. Many people shall be benefited out of your writing.
Cheers!

Natural Phytoceramides's picture

It's an awesome article in favor of all the web people; they will take benefit from it I am sure.

Pristine Derma Serum's picture

Great post.

yoozoo iphone earbud's picture

I think the admin of this web site is truly working
hard for his website, for the reason that here every
data is quality based stuff.

Johne362's picture

As I web site possessor I believe the content material here is rattling great , appreciate it for your hard work. You should keep it up forever! Good Luck. bbeebbebafab

Pages

Add new comment